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Education’s Hand in the New Deal 


HE Annual Meeting of the American Council on Educa- 
tion is traditionally the occasion for review of the most 
significant events of the past year and for planning ac- 

tivities that promote sound advance in education in the year to 

come. 

For education, the event of the year is the mobilization of 
the American people for a new deal. As a result, education 
today faces a challenge comparable to the challenge it faced 
in 1917 when the nation mobilized for war. 

One of the most revealing facts of the present situation is 
the courage and good humor with which the American people 
have met their difficulties throughout the depression. This 
striking fact is a tribute to our schools. That fortitude and 
good temper dominate in times of trouble is convincing evi- 
dence of the fundamental solidity of American education and 
of American institutions. A firm foundation for spiritual de- 
velopment and for economic prosperity is certainly here. No 
one can deny that schools have played a fundamental part in 
laying that foundation. 

On the other hand, certain other revelations have pro- 
foundly shocked us all. These revelations indicate a strange 
and perverted scale of values, not only among bankers but also 
throughout the entire population. Herein lies the essence of 
the present challenge to the schools. They do not give people 
enough help in developing truer scales of value. 

The new administration in Washington opened with a 
frontal attack on this perverted scale of values. In his inaug- 
ural address, President Roosevelt told us that he intends to 
put first things first—sound national economy above interna- 
tional trade relations, interests of depositors above bank divi- 
dends, public service above private gain, creative work above 
money profit, ministering to our fellowmen above being min- 
istered unto. 

President Roosevelt also told us that the situation can never 
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be helped merely by talking about it. We must act and act 
quickly. These presidential policies—Put first things first: 
Then act—may well be adopted by schools as guides to their 
efforts to help people develop truer scales of value. 

When educational institutions in 1917 realized their re- 
sponsibility for helping win the war, they organized the Amer- 
ican Council on Education to promote cooperation for the 
common cause. Because of its significant service in that crisis 
they have maintained it as a center of cooperative action in the 
pioneering adventures of American education ever since. 

This year the Council convenes in the midst of a national 
crisis no less severe than was the crisis of 1917. New respon- 
sibilities for the schools are evolving. What these are and 
what action is needed to meet them effectively will be deter- 
mined at the Annual Meeting, May fifth. 

C. R. MANN. 





Public Education in the Crisis’ 


N THIS presence of members of the Legislature and more 
than four thousand people from all over North Carolina 
we feel stirring within us the traditions and hopes of an 

undefeatable people. They have come from the tidewater 
shores, the agricultural plains, the industrial hills, and the 
mountain towns. Overtaken by a world catastrophe while 
carrying with a high heart the heavy load of their recent great 
investments in roads and schools, they are, in spite of all, re- 
solved to pay their debts and to carry on their bit in North 
Carolina for a better State and a fairer world. 

We take our stand today against no man or party or section 
or creed or class, but as North Carolinians for all of North 
Carolina. Every part needs to consider all of North Caro- 
lina, and all of North Carolina needs to consider every part. 
We are trying for our part to put into the whole picture the 
crisis in public education as a basic problem of the common- 
wealth. We are grimly aware of the miserable condition of 
the country, the desperate situation in this State, and the mood 
of the times,—critical with social high tensions and economic 
potentialities far and near. 


THE ECONOMIC PROSTRATION 


All America at this time looks into the face of a prostrate 
agriculture, paralyzed industry and commerce, and millions 
unemployed. The government has begun to challenge the 
hunger that stalks our streets, but neither the political nor 
economic order has yet lifted the cruel shadow of a wide 
despair that falls across millions of homes where children are 
born. 

North Carolina, an acute part of it all, facing the present 
and future, must look through the eyes of a previous agricul- 
tural and textile decline, the subsequent world depression, and 
the peak load of State debt payments in high money in the 


2 An address before the Citizens’ Mass Meeting on Public Education in Raleigh, 
North Carolina, January 31, 1933. 


127 








128 THE EDUCATIONAL RECORD 


low years of the depression. The state debt at the beginning 
of 1932 was one hundred and sixty-one millions. The local 
debt was three hundred and seventy millions, and the com- 
bined debt was five hundred and thirty-two millions. The 
State will end the year with an operating deficit of twelve and 
a half millions. 


THE PUBLIC CREDIT AND THE PUBLIC SERVICE 


These are hard facts, of which we must all take account, as 
we share with the Governor and the Legislature the responsi- 
bility to preserve both the public credit and the public service. 
The public credit is basic to the public service and to private 
enterprise, and it must be preserved. The public service, the 
public schools, colleges, humanitarian institutions, state de- 
partments and commissions, and all indispensable agencies of 
public health and welfare, are basic to the public credit, to 
economic recovery and the social advance. Without them and 
the vision back of them, the people perish. They, too, must be 
preserved. They are fundamentally what the public financing 
is all about. Though budgets primarily exist for them, they 
should not destroy the budget policy. Nor should budgets 
destroy them. It is the responsibility of the state administra- 
tion to work out the ways and means by which state bookkeep- 
ing and state development are cooperative and not antago- 
nistic parts of the same great processes in the building of this 
commonwealth. In our budget-making we must realistically 
face with a sense of high responsibility both fiscal and social 
deficits, binding obligations to bankers on Wall Street, and 
social and spiritual obligations to youth on Main Street and 
children on the farms, unbalanced budgets and an unbalanced 
commonwealth. The public credit and the public service go 
up or down together. 


THE PLACE OF EDUCATION IN THE BUDGET 


In bringing figures to you we are not bringing merely cold 
figures on a page, but we are bringing flesh and blood in the 
running stream of life and youthful opportunities in the poli- 
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cies of a commonwealth. The total expenditures of the State 
and its subdivisions were in 1928-1929, the year the depres- 
sion began, $117,964,513, and in 1932, $99,206,978. The 
decrease in public expenditures of all kinds was almost nine- 
teen million dollars. Almost half of this decrease was for the 
public schools. The average decrease in the whole State in 
all its subdivisions, departments, institutions, and agencies was 
15.9 per cent. Public education showed a decrease of 23.4 
per cent in its own expenditures. Most of this reduction in 
the cost of public education was in interest and capital invest- 
ment. But over three million dollars of the total was in the 
reduced operating cost of the public schools. Surely the pub- 
lic schools of North Carolina have more than proportionately 
done their part. The public schools have both cut down costs 
and, against the appeals to hate, violence, and despair, held 
high the democratic hope of the people in a dark time. The 
public school teachers with the open door have held the line. 
In North Carolina 4,675 more children, enrolled for more 
than a two weeks longer term with an increased attendance 
of 83,303, were taught by 1,220 less teachers, with over three 
million dollars less money. No other enterprise in North 
Carolina can show so large an increase in business with so 
large a decrease in cost. 


INCREASED COST OF SCHOOLS BEFORE 1929 


But it was logically said that the costs of public education 
had gone up in North Carolina before 1929 and had of neces- 
sity to come down in these times. The spokesmen for the 
public schools are giving you the facts and figures in that 
regard, but we must meet head on certain misrepresentations. 
I would like to recall and emphasize several reasons why 
school costs went up in the years before 1929. One chief 
reason is found in the industrial and social advance of North 
Carolina. Increasingly large numbers of people came to 
North Carolina to work and live, and more and more children 
were born in North Carolina. The people demanded more 
and better schools, and got them. The increase in school 
costs by and large has been due to the fact that there has been 
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a tremendous increase in the number of students for longer 
terms and more years, in better buildings and under better 
trained teachers. 

The larger number of better trained teachers in the schools 
has raised not only the costs of the schools but also the quality 
of the schools. Good teachers have to invest many years of 
their lives and many thousands of dollars to fit themselves to 
be good teachers. This is true in a special way of the best 
teachers and administrators in the public schools and the pro- 
fessors in the colleges. They reach about forty years of age 
before they become school heads or professors, and in many 
cases are still paying off the loans for their graduate training. 
The cut in their salaries, already below the scale of their peers 
in business and the lucrative professions, are taken standing 
up, as their bit for the state and the times. But the significant 
thing for the state is that they find already deep cuts in the 
laboratory, library, and the general tools of efficient work; 
and, also, as the cuts continue into their own personal sense of 
security for efhicient work, they have to cut into their own 
personal tools: books, journals in their fields, attendance on 
professional and learned societies, and their general intellec- 
tual and cultural equipment for their best work. The cumv- 
lative cuts become not so much cuts of an individual or a 
group, but cuts into the life and equipment of a teacher of 
youth. Cuts already have become cuts into what teachers, 
productive scholars, creative scientists, and thinkers have to 
give their students, their generation, and even posterity. The 
students in the public schools and colleges give the precious 
years of their lives, their eager minds, and youthful hopes. It 
is not the part of a great people who know what they owe 
themselves and their children to frustrate their hopes and 
cheapen the quality of the life of a state for a generation. 


THE SALARIES OF TEACHERS 


The quality of the public schools measures the quality of 
the life of a commonwealth. The salary scale of the public 
schools is considered the best standard of the social values of 
a state. To keep on cutting down the salary scale of the 
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teacher is to tear down quickly the slow work of decades. 
Profits and fees in other fields jump back quickly to their 
former comparatively high scale, but not so the salary scale 
of teachers. The attraction of the best talent away from the 
teaching profession into business and the other professions, 
already strong, is setting in strongest at the top; and there’s 
the rub—where it hurts the most. Within the year, three of 
the best school superintendents in North Carolina have been 
employed by commercial houses. Other states have captured 
some of our best trained supervisors. My own county of 
Orange this year cut out a rural supervisor whose absence has 
left not only the children but the whole county poorer for the 
loss of her radiant spirit. It was these better trained teachers, 
better buildings, more children, longer terms, more high 
schools, consolidated county schools and busses, that increased 
the school costs in North Carolina before 1929. 


ANALYSIS OF SO-CALLED FRILLS 


Moreover, a deeper knowledge of the springs of human 
behavior and development, a wider mastery of child psychol- 
ogy, and the differences in youthful personalities, needs, and 
aptitudes have placed upon the schools the responsibility of 
providing a wider range in the choice of courses for the de- 
velopment of the whole personality of the child. These are 
some of the frills which we are cutting out of our schools: 
music, art, and the handicrafts. The better schools are more 
and more recognizing that children are not only different but 
that all of them have souls which need to be nourished on 
truth, goodness, beauty, and the things of the spirit, which 
our civilization at its creative best has to give. We all per- 
sonally know teachers, white and black, teachers of frills, if 
you please, who never miss a chance to take, as best they can, 
to the eager children of their crowded classrooms some bit of 
appreciation of truth, goodness, and moral heroism, and some 
practice in expressing in various art forms more beautifully 
what is deep in the nature of youth. These public school 
teachers of frills and the social sciences, so bitterly under at- 
tack today, have their reward in the faces of their students as 
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they respond to the fugitive beauty of a great painting, the 
majesty of a great opera, the glory of an ancient art, or, in 
the field of the social sciences, as they respond to the challenge 
of social situations and perhaps assimilate into the core of 
their own character the heroism they meet in people and 
books. We teachers have stumbled and fumbled at our jobs, 
God knows, but the best educators of Europe and America 
have tried to work out school programs more and more 
adapted to the personalities and needs of the children. When 
we cut these out now, let us pray God against the necessities 
which tend to deny to many children a little clearer glimpse of 
the complex nature of our society and the simple beauties of 
the earth. 

The needs and demands of the people added still other 
costs. The people all over North Carolina, as all over Amer- 
ica, also demanded that in view of the fact that the larger 
proportion of school children do not go to college, the schools 
should prepare boys and girls not only for college but also for 
the life into which they were immediately going. From demo- 
cratic origins and needs came agricultural, commercial and 
industrial courses; courses in home making, home economics, 
courses in civics and social economics, and spiritual ideals for 
building a nobler society. 


THE SOCIAL SCIENCES 


Many of this generation are grateful to church or state for 
the opportunity in school to catch in the original Greek and 
Latin the sweep of imagination, the beauty, majesty, and no- 
bility of the literatures of an ancient but still gloriously living 
past. Yet we of this generation also feel great gaps in our 
education with our lack of an integrated view of human per- 
sonality and human society. We were not in a socially scien- 
tific way made even aware of the need of building up corre- 
sponding social controls of the revolutionary power engines 
and the mighty but haphazard economic forces let loose upon 
earth by specialized knowledge with the power to destroy or 
rebuild the structure of the modern world. The fact that the 
American people, as a whole, have met the depression with at 
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least a grammar school education and the hope of something 
better for their children, has, we believe, so far prevented a 
violent breakdown. With a higher educational level and a 
wider social mastery the people through the schools and col- 
leges can make impossible another such world depression. A 
chief hope of never again making such a mess of the world as 
our generation has, is in the development of a new personal 
and social sense of the spiritual worth of all human beings as 
children of the Kingdom of God, rich and poor, white and 
colored, tenant farmer and industrial worker, financial leader, 
and the child in the remotest mountain cove; in the develop- 
ment of a new international sense of the brotherhood of men 
and nations in an interdependent world; and in the develop- 
ment of a fresh and more intelligent sense of the need of inte- 
grated knowledge and social guidance, not only through the 
colleges, but also more daily through the high schools, in the 


adolescent years of youth, eager for the great adventure of 
building a fairer society. 


SIGNIFICANCE OF CUTTING SCHOOLS 


When we have been cutting the schools too deeply and dis- 
proportionately, these are some of the imponderable values 
into which we have been cutting. Part of the cutting has been 
a matter of necessary and sometimes wise economies and is a 
natural part of the deflation process. This educational defla- 
tion has, however, become a part of the destructive vicious 
economic spiral downward, cutting more and more into the 
thin purchasing power of the people and the social returns of 
a democracy to those who do the work of the world. The 
economic and social decisions fixed in the budget of a state 
either concentrate privileges in the hands of the few or dis- 
tribute more opportunities to the people and their children. 
In this whole difficult business of keeping books and keeping 
the commonwealth, it should always be remembered that the 
schools of North Carolina at their best were not on an inflated 
basis. The farmers, industrial workers, teachers and low- 
salaried groups were not at all in on the speculative profits, 
but they are altogether in on the deflation losses. They were 
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not on the great joy ride and, as Col. Santford Martin has 
just suggested, not even in the rumble seat. They are, how- 
ever, helping to pay the gas bill for those who were, and with 
a saving sense of humor about the tragic social irony of it all. 
But the thing has gone far enough. 

It has been one of the contemporary American tragedies 
that the depression, together with the necessary drive in 
America to cut down the cost of government, is falling most 
heavily on the schools and libraries of the South, whose peo- 
ple, in their comparative poverty, have struggled so long and 
so hard to bring their schools up toward an averagely decent 
level of worth to all the children of the people. We must not 
forget that the toll of the depression is heaviest against the 
Negro schools. We recall in this connection with democratic 
satisfaction that during these worst years of the depression all 
the schools in North Carolina, rich and poor, rural and city, 
white and colored, by virtue of the McLean Law, have been 
kept open the entire constitutional term. Yet the North Caro- 
lina public schools at their best were far below the American 
average of costs in 1929. Three millions have been taken out 
since 1929. Now it is proposed to take out of the public 
schools in the next biennium some four million dollars more. 
The schools have the patriotism to try to do the best they can, 
but the people do not have the capacity to sustain such a vital 
body blow against the resources of recovery and hope for a 
fairer deal in the policy-making of a great State. 

The people of North Carolina have taken their stand here 
today and in hundreds of communities from which this meet- 
ing draws its hopes and gathers its strength. The cause of the 


public schools is the cause of the people and of the future of 
North Carolina. 


THE UNIVERSITY AND THE PUBLIC SCHOOLS 


It is only natural that the spokesman for higher education 
and the University of North Carolina should take his stand 
on, with, and for the public schools. The public schools of 
North Carolina were born at Chapel Hill. Caldwell, Murphy, 
Yancey, Wiley, Alderman, Mclver, and Aycock are dead, but 
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the public schools which they dreamed, founded, and builded 
still live and will live as long as North Carolinians carry on 
their most precious tradition and develop the resources of 
their strength. In taking a stand for the University and 
higher education we are standing for the public schools. The 
public schools, the colleges, the universities, the farms, the 
factories, stores, banks, libraries, churches, and the people and 
their children, rich and poor, black and white, are all tied 
inextricably together in this commonwealth. The schools and 
the University of the people go up or down together. 


HIGHER EDUCATION AND THE STATE 


Let us now look at the budget of the State and the propor- 
tionate decrease for higher education in North Carolina. The 
decrease in public expenditures for current maintenance and 
operation of all divisions and agencies of the State was from 
63 million in 1929 to 54 million in 1932. The average de- 
crease in all divisions and agencies of the State in current 
operating costs to the State was 14.8 per cent. The institu- 
tions of higher learning and teacher training showed a de- 
crease in costs to the State of 42.8 per cent. The University 
of North Carolina, as a fair illustration of them all, received 
$894,000 from the State in 1929, was voted $721,000 by the 
last Legislature for this year, but will receive $504,000. It is 
proposed by the Budget Bureau that the University at Chapel 
Hill receive $390,000 or a cut of 56 per cent since 1929. It 
is proposed to give the three combined units of the Consoli- 
dated University less money by $130,000 in 1934 than was 
given to one of those units in 1929. These figures are no less 
true of all the State educational institutions. As a symbol of 
the stakes of all the institutions, the proposal for $390,000 
for the University at Chapel Hill has not only stirred the con- 
science of the State but has shocked the whole university 
world. 

It is common knowledge among the great universities of 
America, all of which have tried to draw away the strongest 
men in the faculty of the University, and many of which have 
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made no salary cuts, that these professors stayed at Chapel 
Hill at less than half the salaries offered elsewhere. They 
have stayed after being cut twice. Sixty-one have refused 
ninety offers totalling more than $100,000 annually above 
what they receive at Chapel Hill, not counting the second cut. 
Their work is a productive part of the life and thought of this 
State. Their names are respected and their research is utilized 
by scholars on five continents. We could not again perhaps 
gather a like company of teachers, productive scholars, scien- 
tists, and thinkers for much more than their total salary fund 
at any place in America. We cannot at Chapel Hill build 
another such faculty in this generation. This is not my opin- 
ion. It is the verdict of the university world. They love the 
University, and enjoy their work with the students hopefully 
gathered there under the ancient oaks with a rootage deep 
in the soil of a great tradition. They and their compeers in 
all our colleges have given their best to North Carolina and 
their generation. Their work has been for all the people of 
this State, whether white people or colored people, tenants on 
farms, workers in factories, people in cities, or people in the 
countryside. They have joined in any cause that has had to 
do with trying to make our State a little better from day to 
day with bits of dreams thrown in out of which great com- 
monwealths are made. They have refused to go. North 
Carolina will not drive them away. 


LOW PER CAPITA COST 


The University of North Carolina compared with like in- 
stitutions in the country is a poor institution. It has the 
lowest per capita cost of any institution of its rank in America. 
As I stand here today as a spectator of history, I see rising 
again in North Carolina, out of the ruins of reconstruction, 
and somehow out of the poverty and dreams of a people, one 
of the acknowledged great universities of America. She gladly 
and proudly joins hands today with the State College of Agri- 
culture and Engineering and the Woman’s College, both with 
noble traditions and high capacities, basic to the work and 
hopes of North Carolina for a better day, as the consolidated 
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symbol of the cause of higher education in North Carolina, 
white and black, East and West. 

In the common cause, she stands today with her back to the 
wall, but it is a wall of youthful hopes and a people’s faith 
that will not let her down. She seeks to understand those who 
would strike her down. Her intellectual integrity and her 
freedom she would preserve at the cost of all her appropria- 
tions. The University, her sister institution and the schools 
ask for the right to live, the freedom to think, and the oppor- 
tunity to help North Carolina do her bit in the great task of 
recovery and reconstruction. 


THE LONG-RUN VIEW 


We must see our State problem of reconstruction in the 
long-run view of history, with its eventual rejection of pana- 
ceas and magic formulas, and in the wide view of the world, 
in whose present catastrophe this State is deeply involved. We 
must not in an hour of hysteria cut to a cheap level the gov- 
ernment of the people. A less intelligent government will 
mean a more wasteful government. Less government of the 
people will mean more privilege for the few. We cannot hack 
our way out by an unintelligent attack on the public schools, 
public service, humanitarian institutions, and those agencies of 
social information and control which have grown up to pro- 
tect, guide, and develop the life of the people in response to 
their needs in the complex modern world. To tear down is a 
wasteful way to pay up or to get out. We must pay our long 
running debt by the long run building up of the intelligent and 
spiritual powers and capacities of the people and their chil- 
dren. We cannot back our way out into a simpler society 
without a crash of that great mechanical framework now 
flung around the earth which even in this low year of the de- 
pression still holds up the structure of our modern world. 

In the nineteenth century through the schools, colleges, and 
laboratories, we mastered the physical earth for its productive 
power. In the twentieth century we must master our produc- 
tive power for all people. In the schools, colleges and uni- 
versities we stand with inquiring minds along the frontiers of 
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the vast social possibilities of our yet unmastered civilization. 

We must more intelligently and fairly adjust the social 
balance of the machines that produce, the banks that control, 
and the people who consume. We must create our way out 
toward the great society and the Kingdom of God. We must 
invest in the intellectual and spiritual resources of youth. The 
children of this depression are not, by our neglect, to be the 
lost generation, but are, by our faith, to be the generation who 
will rebuild a fairer world! 


FRANK P. GRAHAM, 
The University of North Carolina. 





Citizens’ Councils for Constructive 
Economy 


N JANUARY 5, 1933, a group of citizens met in 
Washington at the call of the President of the United 

States to consider the crisis in education. Members of 

this group were selected by national organizations representing 
agriculture, business, government, education and public welfare. 

Among the seventy who attended, there were eleven labor 
leaders, eleven agricultural leaders, six leaders in business and 
industry, four experts in taxation and budget making, two 
economists and political scientists, two lawyers, six leaders of 
civic organizations, ten university presidents and professors, 
ten state and city superintendents and other leaders of public 
education, two government officials, and six men of various 
other professions but interested in this topic. 

One of the findings of this conference was the recommenda- 
tion that there be set up in every community Citizens’ Councils 
broadly representative of all interests to clarify and mobilize 
public opinion in matters of vital concern to the community. 
This proposal attracted the attention of a number of national 
organizations and led to three informal conferences in New 
York, Chicago and Washington to consider plans for its reali- 
zation in practice. 

Each of these three conferences unanimously approved the 
proposed organization of local Citizens’ Councils and appoint- 
ed a small committee to make plans. The members of these 
committees constitute the central committee. They are: 


Carl H. Milam, American Library Association, Chairman, 
Mrs. Hugh Bradford, National Congress of Parents and Teachers, 
Louis Brownlow, Public Administration Clearing House, 

Harold S. Buttenheim, The American City, 

Ray Fife, American Vocational Association, 

Arnold Bennett Hall, The Brookings Institution, 

Lee F. Hanmer, Russell Sage Foundation, 

Fred Hewitt, American Federation of Labor, 

Charles H. Judd, University of Chicago, 

Charles R. Mann, American Council on Education, 

John K. Norton, Columbia University, 

Milton E. Potter, Superintendent of Schools, Milwaukee, 
Clarence E. Ridley, International City Managers Association, 
Paul C. Stetson, Department of Superintendence of the N. E. A. 


139 








140 THE EDUCATIONAL RECORD 


The general committee has held two meetings. It agreed 
that the end sought could not be achieved by any over-all na- 
tional action, but only by appropriate cooperation of citizens’ 
groups in each community and state. It was therefore voted 
that all national organizations interested in better public ser- 
vice in any of its phases should be invited to encourage their 
members to participate in the organization of local citizens’ 
councils. It was also agreed that a local Citizens’ Council 
should be a council of representatives of existing citizen groups 
and public boards, not a large membership organization which 
might tend to duplicate and weaken present groups; also that 
each Council should be completely autonomous. 

By way of suggestion to national organizations and their 
members concerning the organization, function and activities 
of such Citizens’ Councils, the general committee has prepared 
the following statement.’ Since conditions in various com- 
munities differ widely, no one statement would apply to all 
communities. It is hoped that each community will find herein 
hints and suggestions that will be useful to it in organizing a 
local citizens’ council that will meet effectively the conditions 
peculiar to its own community. 


OBJECTIVES 
The objectives of a Citizens’ Council are: 


1. To promote interest in local and state governmental 
problems, to the end that the present widespread demands for 
reduction of public expenditures may produce actual and per- 
manent improvements in the governmental organization, the 
tax system, and the services rendered by public and semi-pub- 
lic agencies. 

2. To encourage the organization of local and state Cit- 
izens’ Councils to consider the problems of maintaining essen- 
tial community services in the face of the need for reduction 
of public expenditures. 


WHAT WOULD A CITIZENS’ COUNCIL DO? 


In general it would do anything it could to promote con- 
structive economy in local and state government and assure 


* Additional copies of this statement may be had without charge from the 
office of the Citizens’ Conference on the Crisis in Education, 744 Jackson Place, 
Washington, D. C. 
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the maintenance of socially useful public and semi-public ser- 
vices. More specifically it is suggested that members of your 
Citizens’ Council begin by informing themselves about local 
expenditures and services through seeking the answers to such 
questions as the following—beginning with whatever specific 
problem is most acute in your community. 


FOR IMMEDIATE CONSIDERATION AND ACTION 


A. For what services do you pay? How much? 


1. Has the school enrollment increased? In what grades? 
Are demands for adult classes less or greater than formerly? 
What economies have been put into effect? What were total 
expenditures and expenditures per capita of the population 
for each of the last three years? How much of this is for the 
debt service? What are the schools’ chief problems? 

2. What are the comparable facts about libraries, museums, 
playgrounds, parks, public health and sanitation, relief, wel- 
fare, hospitals, police and fire departmerts, streets and roads, 
other city departments, city planning, and municipal adminis- 
tration? (Include non-governmental public services such as 
relief, welfare, local college, etc.) 

3. How do the total per capita expenditures, and the per 
capita expenditures for each activity, compare with those in 
other cities? How can you account for the variations? More 
or less service? Better or poorer service? Wasteful or more 
efficient operation? 

4. How do qualifications for positions and salaries paid in 
the several departments compare with each other and with 
those of other cities? 

5. What are the budget estimates for expenditure for each 


activity? For all activities? How do these figures compare 
with probable receipts? 


B. How efficient is the administration of these services? 


6. Which of the services (as above) are operated most ef- 
ficiently? Which are manned by executives and employees 
chosen strictly on the merit basis? Which have good busi- 
ness administration, budget control, etc. ? 

7. To what extent are materials, supplies and equipment 
for your local government purchased through one central 
agency? 

8. Does your local government have a satisfactory execu- 
tive budget which actually works, so that a taxpayer may know 
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in advance what the government proposes to spend for a cer- 
tain activity, can favor or oppose such expenditure before it 
is authorized, and can be sure that once authorized, the 
amount of expenditure will not be altered, save as a result of 
unanticipated shrinkage in revenue? 

9. What suggestions can be made for the elimination of 
waste and the improvement of service, this year or next? 


THE LONGER VIEW 


10. How many separate governments levy taxes on your 
property? City, village or town, township, county, special 
boards, state? Are all these layers needed? 

11. How high are tax delinquencies? To what extent is 
an inefficient system of tax collection responsible? 

12. Under what conditions does your local government 
permit payment of taxes on the installment plan? What are 
the benefits or the wastes of such a tax collection system? 

13. Is the tax year so coordinated with the budget year 
that it is unnecessary for your local government to pay in- 
terest on money borrowed in anticipation of taxes? How 
much is spent annually for interest on temporary loans? How 
can such interest payments be avoided? 

14. On what basis is property assessed in your community? 
How wide is the variation in assessments on similar types of 
property? How much injustice results? 

15. To what extent can one person or a small group of 
persons be held responsible for the efficient administration of 
all municipal services? 

16. How well do semi-public agencies cooperate? How 
well are they united? To what extent do rivalries cause need- 
less expense? 

17. What does the township government cost? What use- 
ful purposes does it serve today? What benefits would accrue 
from having fewer and larger counties? 

18. What waste is occasioned by the employment of unfit 
persons in the public service of your community? What steps 
can be taken towards the establishment of a merit system of 
employment? 

19. To what extent do existing charter provisions or state 
laws put barriers in the way of improvement in government 
in your community? Is more or less home rule desirable for 
your community? How can you cooperate with other Cit- 
izens’ Councils in the state to change provisions of the state 
law or state constitution, so as to provide such home rule as 
would permit you to improve your local government ? 
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20. To what extent are public works activities in your city 
and county located and carried out in accordance with a care- 
fully prepared city or regional plan, thus avoiding the wastes 
inherent in lack of such planning? 

21. How can the cost of maintaining the necessary services 
be more equitably distributed ? 


METHOD 
It is suggested that your Citizens’ Council: 


(a) Invite the heads of the important activities to con- 
tribute essential facts and opinions. 

(b) Get for yourselves and for local officials the best ad- 
vice obtainable from state departments, state institutions, 
local, state and national organizations and other experts, and 
intelligent, socially-minded citizens. 

(c) Compare the services rendered in your community, the 
costs, and the governmental organization, with the standards 
and recommendations prepared and published by state depart- 
ments, national organizations and specialists. Ask the librarian 
of your public library to assemble for the use of the Citizens’ 
Council useful publications—especially pamphlets and peri- 
odical articles. 

(d) Appoint members of the Citizens’ Council to visit 
special institutions and departments. 

(e) Urge all institutions and departments to give continu- 
ous publicity to their activities. 

(f) Encourage participation in the investigation by the 
several cooperating organizations, to the end that each organ- 
ization may do what it is best qualified to do; and make sure 
that the facts and expert opinions assembled by each organ- 
ization and each committee of the Citizens’ Council are made 
available to all the members of all the organizations. 


Note: The foregoing statement concerning Citizens’ 
Councils was issued by the central committee on March 20th 
and is being distributed widely by the national headquarters 
of over fifty national organizations that are interested in se- 
curing the greatest possible benefit from the expenditure of 
public funds in every community. Attention of educational 
institutions is particularly directed to the twenty-one questions 
which suggest live projects for classes in Civics and Govern- 
ment.—ED. 





The Emergency in Education’ 


ARLY in January the officers of the National Education 
Association and of the Department of Superintendence 
appointed a Joint Commission on the Emergency in 

Education. The Commission met promptly, quickly appraised 
the current educational situation, and outlined a program, 
which was immediately put into action with the cooperation of 
the headquarters staff of the Department and of the National 
Education Association. 

We are ready to report some of the things which have been 
done to date, and to indicate certain plans for the immediate 
future. 

The situation created by the depression has confronted the 
schools with a variety of difficult problems. These have been 
aggravated by the disposition of certain shortsighted and self- 
ish interests to use the depression as a cloak for an attack 
upon our system of free public schools. We recognize the 
present situation as a serious emergency, which calls for emer- 
gency action. 

Accordingly the Commission has organized as a board of 
strategy. It will serve as a rallying point for the forces made 
up of teachers, parents, and public-spirited citizens interested 
in the maintenance and improvement of America’s system of 
free public schools. The Commission is organizing so as to 
be able to exert the full force of the million members of the 
teaching profession, and of the many millions of parents and 
citizens interested in preserving the idea of free public educa- 
tion, and of making that idea increasingly articulate in im- 
proved schools and colleges. It will not shrink from taking 
the offensive, in cases where that seems the thing to do. It 
will not forget that it is representing a profession. It will not 
hesitate to use practical methods to make the influence of the 
profession felt. We have been meek long enough. The time 
has come to go out against those who, because of selfishness 


* Report of the Joint Commission presented at the meeting of the Department 
of Superintendence in Minneapolis, February, 1933. 


144 





THe EMERGENCY IN EDUCATION 145 


or ignorance, or both, would make children the victims of the 
depression. 

The Commission is taking the initiative in dealing with cer- 
tain educational problems of common concern to all, which 
can be most effectively dealt with on a national basis. It rec- 
ognizes clearly, however, that its program will be most influ- 
ential and helpful if it works in close cooperation with, and 
through, the school systems and educational organizations of 
the various states and localities. It will profit from the effec- 
tive work which is already being done by these agencies, will 
seek to pool their experience, and to develop plans for united 
action. 

We will call upon those in all ranks of the profession for 
advice and counsel as we proceed. We will need their aggres- 
sive support and will expect to have it in carrying out action 
decided upon. 

There is sufficient time to permit a few indications of the 
program which has already been outlined and part of which 
has already been put into action. 

It was decided that instead of shrinking from the attacks 
which are being made upon public education, we should meet 
its challengers on their own grounds. Accordingly a project 
is being organized whereby the public in general will be en- 
couraged to give answers to the questions which are being 
raised concerning the purposes and scope of public education. 
For example, do the parents of this nation want, or do they 
not want, free public high schools? Does the principle still 
hold that every child shall be provided the particular oppor- 
tunities which are required in order that he may develop such 
talent as he may possess? We will seek mandates from the 
rank and file of parents and of citizens on questions such as 
these. 

This project is based on the principle that, if the purposes, 
scope, and procedures of public education are sound, they will 
bear scrutiny even in a time of depression, and that such 
scrutiny will strengthen the position of the schools. If the 
purposes, scope, and procedures of public schools are not 
sound, then the sooner it is known, the better. 
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Already material has been prepared and plans for this cam- 
paign of educational appraisal have been outlined. You and 
others in the field will hear about them soon. 

In another project, we are seeking to gain an accurate ap- 
praisal of the methods which are being used by the schools in 
dealing with the difficulties which have resulted from the de- 
pression. A collection of bulletins and publicity materials is- 
sued by schools with depression problems in mind have been 
assembled from all over the nation. Many of these are now 
available for your inspection in booths A-1 to A-29, near the 
registration desk in this auditorium. If you have not seen 
these materials, inspect them before you leave. They will give 
you ideas for use at home. Extra copies of some of the out- 
standing publications are available for distribution. 

A careful tabulation of all letters received, in response to 
President Potter’s recent communication to members of the 
Department, has been made. Many thoughtful suggestions 
came in. We appreciate this cooperation and wish you to 
continue it as the work of the Commission progresses. 

A survey has been made of the national organizations, pub- 
lications and other agencies which are exercising influence, or 
which might exercise influence, on the development of educa- 
tion. We expect to know more accurately who is for, and 
who is against, free public education, and why. We will use 
the information gained on these questions. 

We are greatly encouraged to discover how many groups 
are ready and anxious to fight for the American and opposed 
to the European idea of what a school system should be. We 
are interested in what we are beginning to find out as to the 
sources of the propaganda which is now appearing against 
education. 

We are giving particular attention to the matter of educa- 
tional publicity. Many states and localities are now doing 
excellent work in this field, as the exhibit already mentioned 
clearly reveals. But there are some places where the contact 
of the school with the public needs to be placed on a more 
effective basis. We are now developing and will widely dis- 
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seminate material designed to assist in bringing this about in 
all areas—local, state and national. 

The commission is immediately seeking the advice, aid, and 
aggressive support of all organized groups of the profession. 
We have developed plans to get in closer touch with many of 
our national and state organizations through a series of re- 
gional conferences, to which the executive heads of these or- 
ganizations will be invited. Through these regional confer- 
ences we plan to reach the state commissioners of education, 
the officers of state educational associations, the presidents of 
all the departments of the National Education Association, 
and the officers of numerous other societies, committees, and 
commissions. We are also planning to ask the members of 
the executive committee of the Department of Superintendence 
to participate in one or more of these regional conferences. 

At these conferences the program of our commission for the 
defense of. public education will be presented. An occasion 
will be given for the presentation of problems and plans of 
state and national groups. Our Commission hopes to serve 
as a coordinating committee for the efforts of various profes- 
sional bodies. 

It is anticipated that the discussions in these regional con- 
ferences will tend to strengthen the determination of the lead- 
ers to make a vigorous defense of the educational rights of 
children. 

May we urge that our professional organizations stand 
ready to pay the expense of the attendance of their officers at 
these regional conferences. We do not have the financial re- 
sources to bear such expense. 

Through conferences with professional and lay groups, our 
Commission hopes to build within the next few months a pow- 
erful organization committed to the patriotic and unselfish 
task of saving the schools and protecting the educational in- 
terests of growing children. In such an undertaking we an- 
ticipate the enthusiastic support of millions of teachers, 
parents, and other patriotic citizens, and the active opposi- 
tion of certain selfish groups who are willing to place their 
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financial interests above those of the great mass of American 
citizens. 

We believe that there should be no question anywhere as to 
what is the spirit of the teaching profession at this time. A 
serious emergency confronts the whole nation. Millions are 
out of work. What is the duty of teachers in such a period? 

In such a time it is the duty of teachers and all public ser- 
vants to reduce public expenditures to the lowest possible cost 
consistent with the maintenance of essential services. This is 
being done by the schools. Non-essentials have been elimi- 
nated. Rigid economy is being practised. The size of classes 
has been increased. Salaries have been lowered. In some 
communities even essential parts of the school have been dis- 
continued. Terms have been shortened. In some sections the 
schools have been closed. 

In a number of communities the depression is creating a sit- 
uation where the members of our profession must choose be- 
tween depriving the pupils of essential educational services or 
of making heavy sacrifices of our time, energy, and personal 
resources. 

When it becomes clear in any community that these are the 
only alternatives, but one choice is possible for our profes- 
sion. We would prefer to make personal sacrifices rather 
than to have children denied their educational birthright. 

It is this loyalty to children that has won for teachers in 
many communities the admiration of parents and that has 
paved the way for effective cooperation in the defense of the 
schools. 

Health service, kindergartens, libraries, night schools, and 
other indispensable educational offerings must be maintained. 
The integrity of the public school must be guaranteed at any 
cost. This is of first importance if the morale of parents is to 
be maintained during this difficult period and if the children 
of the nation are to be prepared to meet the problems that 
lie ahead. 

The schools, in common with other institutions, such as the 
home, the church, government and private business and indus- 
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trial enterprises, are being severely criticized. What response 
should teachers make to these criticisms ? 

In a period such as the present, it is not remarkable that 
people should be asking what is wrong. It is of the greatest 
importance that teachers should turn an attentive, even though 
a discriminating, ear to the criticisms which are being made of 
education. It is true that some of it is purely destructive. It 
seeks merely to beat down school costs so that taxes may be 
reduced. But there is more to it than this. There are thought- 
ful people who look at the school and see places where it can 
be improved. Shall we resent their criticisms or profit from 
them? The latter is the more intelligent course. The teachers 
of the nation cannot wisely disclaim all responsibility for the 
evils which now beset the nation. To do so would be to pro- 
claim that the school is a futile organization. 

But this is not all there is to it. It is becoming increasingly 
clear that the schools alone cannot bring about the improve- 
ments which are called for in American economic, political 
and social life. 

Industrial organization creates great cities with congested 
streets and crowded slums. But it is slow to provide public 
playgrounds, auditoriums and other facilities essential to 
sound education and to healthful life and recreation in a great 
city. Business men expend billions in advertising—a most 
effective form of education. What motives in human nature 
does advertising select and prey upon? The home, even when 
qualified to undertake many of the most crucial parts of a 
child’s education, too often passes the responsibility over to 
the school. How many churches are still lost in narrow dis- 
tinctions of creed, while they only glimpse the vital contribu- 
tions which they might make to the larger spiritual and social 
welfare of their communities. In short, society too frequently 
parks its social responsibility at the school door, and then goes 
away and forgets all about it. 

Not only the school but all institutions and agencies which 
actually educate children and adults must feel some responsi- 
bility for education, if the results of the mal-education which 
now afflicts our nation are to be eliminated. A better edu- 
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cated people can result not merely by providing a more dy- 
namic school. Every factor which is actually developing and 
educating must accept responsibility along with the school for 
the educational results which are obtained. 

The teachers of the nation stand ready as loyal citizens to 
make every personal sacrifice necessary to protect children 
from the effects of the depression. But they cannot join in 
the defeatist attitude which accepts the current conditions as 
either necessary or permanent. 

The nation contains within its borders everything necessary 
for a high standard of living for all. We inhabit the richest 
region on the globe, our people are not excelled either in 
willingness to work, or in the intelligence they bring to their 
work. We have outrun all nations in the development of ma- 
chines and other means of production and distribution. Our 
resources include every essential to the maintenance of the 
American standard of living, including educational opportu- 
nities for all children, regardless of whether their parents are 
wealthy or poor. Our present unhappy situation is not due to 
a lack of resources. It comes from a failure to use these 
resources. 

We call upon those who sit in the key places of business and 
financial control to spend less time and money in subsidizing 
economy leagues and so-called taxpayers’ organizations, which 
indiscriminately strike at every public service, including the 
schools which the people have created to educate their chil- 
dren. The fact which should absorb the attention of these 
leaders is that their shortsighted and, in some instances, selfish 
and dishonest management is one of the prime causes which 
has reduced the yearly income of the American people from 
ninety to forty-five billion dollars. It is this forty-five billions 
of lost income which lies back of the difficulties of the present 
period. Restore this lost income and it will be easy for the 
American people to pay the two billion dollars a year which 
the public schools cost. 

The teachers stand ready to join with industrial, financial, 
and political leaders, and with all other groups, in carrying 
forward any sound program for economic reconstruction. 
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They will oppose with every resource at their command, both 
as citizens and as teachers, the effort of any selfish group to 
create a peasant class in the United States. Peasant standards 
are not necessary in our country either in educating children 
or in other areas of life. Teachers will stand four-square 
with parents and with all intelligent citizens of the nation to 


fight the imposition of such standards upon the American 
people. 


Joun K. Norton, Chairman, Professor of Education, 
Teachers College, Columbia University, New York, 
N. Y. 

J. B. EpmMonson, Dean of School of Education, Univer- 
sity of Michigan, Ann Arbor, Mich. 

SIDNEY B. HALL, Superintendent of Public Instruction, 
Richmond, Va. 

Mrs. F. BLANCHE PREBLE, Department of Classroom 
Teachers, N. E. A. 

PauL C. STETSON, Superintendent of Schools, Indian- 
apolis. 

A. L. THRELKELD, Superintendent of Schools, Denver, 
Colo. 

HERBERT S. WEET, Superintendent of Schools, 13 Fitz- 
hugh Street, South Rochester, N. Y. 

Davip E. WEGLEIN, Superintendent of Public Instruc- 
tion, Baltimore, Md. 





Training for Research in the Social 
Sciences’ 


ROM its beginning in 1924 the Social Science Research 
Council has continuously had as a major objective the 
improvement of research personnel. One means to this 

end, the Council’s post-doctoral fellowship program, inaugu- 
rated in 1925, has, in its planning and administration, not only 
clearly demonstrated inadequacies in the early training of a 
majority of the candidates, but has also offered the Council an 
unusual opportunity for viewing the situation in this field on a 
national scale. As a result of these conditions, the Council at 
its annual meeting at Nantucket in 1931 requested that its 
Committee on Social Science Personnel study and advise the 
Council in regard to the present status and needs of research 
training in the social sciences. This summary of the commit- 
tee’s tentative findings and queries is here presented in the 
hope of focusing attention on the outstanding educational 
problems involved and of offering at least a point of departure 
for administrative and faculty discussion, and perhaps action. 

The committee has concerned itself with problems of re- 
cruitment as well as of training. In regard to the former, it 
is sufficient here to state that the committee is of opinion that 
the social sciences are not recruiting for research careers an 
adequate number of college graduates of the best quality, and 
that this failure is due in part to the character of the training 
currently given in these fields with its repercussions on the man 
and on his prestige in the public mind. With this note of the 
evident relation between the two problems, it is to training 
that attention is here directed. 

The American graduate school has, over half a century, 
taken on a formidable function which now seriously handicaps 
it in fulfilling its original mission of advancing knowledge and 
training others to do likewise. The graduate school has been 
inundated with vast numbers of students neither capable of 


*Supplement to the 1931-32 Annual Report of the Social Science Research 
Council. 
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nor interested in creative scholarship or scientific research. 
Two educational developments account for this influx: (1) 
the general requirement of the Ph.D. degree as a qualification 
for college teaching and its use as a device for accrediting 
colleges, and (2) the gradual adoption by educational author- 
ities of the M.A. degree as a prerequisite for teaching posts in 
the better secondary schools. Concomitantly, the nation-wide 
emphasis upon formal teaching-training has tempted scores of 
institutions, ill-prepared to do so, into offering work for grad- 
uate degrees—first the M.A. and later the Ph.D.—in order 
to expand their student clientele and thereby support claims 
for increased appropriations and endowments. 

As this circle has revolved, the graduate schools organized 
for the purpose of protecting scholastic standards and, if pos- 
sible, the value of the Ph.D. degree, conferred in numbers 
increasing from 126 in 1890 to 1064 in 1924. (Cf. U. S. 
Bureau of Education Bulletin, 1928, No. 25, p. 807.) Fear 
was expressed that the degree would lose its original signifi- 
cance. Detailed regulations and procedures were gradually 
set up to insure everywhere minimum standards relative to 
period of residence, field and course requirements, language 
requirements, preliminary and final examinations, thesis work, 
etc. The inadequate collegiate backgrounds of so large a pro- 
portion of the students admitted to graduate work naturally 
accentuated this trend, the M.A. degree becoming in most 
institutions little more than a super A.B. degree. 

What we have been describing is a trend toward standard- 
ized mass-production in which cultural values have been largely 
submerged in the quest for pedagogical trade-union labels. 
Regardless of individual differences in aptitude or objectives, 
all have been subjected, under this system, to substantially the 
same institutional treatment—the élite, as President Lowell 
recently expressed it, ‘‘ambitious and capable of high intellec- 
tual attainment,” along with “those of less ability, earnest and 
industrious, but not gifted with the qualities that will bring 
distinction in later life’’; the few endowed with genuine poten- 
tialities for original research, as well as the many earnest 


plodders. 
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The typical features of this training pattern are as follows: 
1. An insistence upon a minimum period of three years of 
graduate study for the Ph.D. degree, with at least a full year, 
in some cases more, in residence at the institution granting the 
degree. 

2. The extension to the graduate level of the course-credit 
system, partly as the least troublesome means of handling 
large numbers of mediocre and poorly trained students, partly 
as a convenient measure of university fees to be collected. 

3. A requirement that each candidate pass an examination 
in two modern foreign languages, only too often without in- 
suring a sufficient command of either language to make their 
literature practically available. 

4. A preliminary (or qualifying) examination for admis- 
sion to Ph.D. candidacy, usually given not before the latter 
half of the second and frequently not until the beginning of 
the third year, an examination which, whether written and/or 
oral, has tended to reflect principally the content of required 
courses instead of testing the maturity of the candidate’s grasp 
of a general subject. 

5. The requirement of a dissertation to exhibit capacity for 
investigation and independent thought, if not always to con- 
tribute new theoretical or factual knowledge; work on this 
thesis ordinarily not getting under way before the end of the 
second year, often not until well in the third year; and the 
materials upon which it is based being limited in too many 
cases to documentary or other immediately available data. 

6. The emergence of a kind of vested interest of the grad- 
uate student, with the effect of permitting, on humanitarian 
grounds, a surprising number of marginal students to hurdle 
the intermediate barriers and eventually slide through to the 
Ph.D. degree. 

7. In short, the failure to discover early and to differentiate 
appropriately between teaching and research ability in the ap- 
plication of institutional rules and departmental procedures 
relative to formal course requirements, examinations, work in 
residence, type of thesis, and so on. 

The prevalent programs of graduate training in the social 
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fields do not give the student direct contact with the phenom- 
ena which he studies. The student may, as regards his work, 
remain well-nigh as cloistered as in the Middle Ages. An 
analysis of the applications before the Council’s Research 
Fellowship Committee year after year reveals how few of the 
candidates in the course of their previous training have been 
inspired and prepared for a life of research, how few have 
been really interested in broadening the base of their training, 
in securing a first-hand knowledge of social institutions, or in 
acquainting themselves with the scientific work and interests 
of related fields which might deepen and enrich their under- 
standing of their own specialized problems. All too many 
appointees have employed their fellowships primarily for the 
purpose of rounding out the investigation of a specific problem 
begun in the doctoral dissertation. The drive for the earliest 
possible publication of a substantial piece of research as the 
surest means of winning an increase in salary, promotion in 
rank, or an offer from a better institution, has apparently 
made most of our younger Ph.D.’s unwilling to undertake a 
lengthened program of advanced research training. 

Without slighting the importance of providing an adequate 
corps of intelligent and broadly trained teachers for our sec- 
ondary schools and colleges, and realizing that the provision 
of effective teachers is vital to the development of research 
personnel, the committee is convinced that the tasks confront- 
ing social science in the next ten or fifteen years call impera- 
tively for an increasing supply of first-rate research men 
equipped to explore the complex problems of society and capa- 
ble of commanding the respect and confidence of the thinking 
public. In focusing attention upon this objective, the commit- 
tee assumes that the types of training now provided in our 
better graduate schools will continue to be available and that 
the effective scientific work now being done by the beneficiaries 
of that training will go on. It is clear, however, that the 
tendency toward a standardization of graduate requirements. 
frequently for purposes of convenience and on account of in- 
adequate institutional facilities, has been a real barrier to the 
stimulation of potential social research personnel. The com- 
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mittee therefore recommends that at least some graduate stu- 
dents of exceptional promise be given an opportunity to follow 
a different program and that, to this end, our graduate schools 
should adopt a more flexible system of graduate training than 
now prevails. 

Hopeful experimentation in the direction both of higher 
standards and of more flexible methods is under way in a num- 
ber of institutions. In the paragraphs that follow the com- 
mittee has endeavored to classify and interpret the more im- 
portant types of change of which it has been able to secure 
knowledge. The examples here cited do not constitute an 
exhaustive enumeration but are suggestive of current trends. 

1. Adoption of Selective Standards of Admission.—Steps 
for setting up more rigorous standards for admission to grad- 
uate study are noted, although there is as yet no general agree- 
ment as to what the criteria of selection should be, and a wide- 
spread feeling still persists that no selection is feasible until 
after the applicants from the colleges have been observed and 
tested on the ground. Restriction of admission ordinarily to 
graduates with honors, or standing in the upper third of the 
senior class, or election to Phi Beta Kappa, or the accomplish- 
ment of distinguished work in a special field, and authoriza- 
tion to departments experimentally to test out various meth- 
ods of selection, are among plans adopted or under consid- 
eration. 

Although realizing the immediate practical difficulties, espe- 
cially in the tax-supported institutions, of refusing entrance to 
any considerable proportion of the graduates of accredited 
colleges, the committee is inclined to believe that some reduc- 
tion in aggregate student enrollments is desirable in order to 
release more time and energy of departmental staffs for the 
informal supervision of genuinely talented students. In a 
time of economic depression, when fewer academic jobs are 
available, conditions would seem to be peculiarly favorable 
for advancing in this direction. Otherwise, we may continue 
indefinitely to have a large, unemployed academic “prole- 
tariat” on our hands. 

2. Development of Devices for Weeding Out Mediocre 
Material at the First-Year Graduate Level_—More may be 
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expected from this than from the preceding development. One 
of the worst sins of graduate school departments has been to 
allow unqualified students to stay on beyond the M.A. stage. 
As things stand in most institutions, 85 per cent or thereabouts 
of those qualified for research are obliged for economic rea- 
sons to teach part of the time; but we do not know who are 
really qualified for research and who are capable only of 
teaching and merely pretend to have research ability. To de- 
termine who shall be encouraged and who shall be discouraged 
calls for procedures whereby the student’s capacity to do inde- 
pendent work of a reasonably high order may be gauged. An 
acceptable record in conventional lecture courses, many of 
them pitched more on the college than on the graduate level, 
is not a reliable criterion. Furthermore, where the body of 
first-year students is large, opportunities for informal personal 
contact between student and staff are usually slight. In cer- 
tain departments, however, the pro-seminar is now being tried 
out as a device for weeding out the unpromising. One univer- 
sity administration recently placed upon each division or de- 
partment “the responsibility of scrutinizing more carefully 
than before the records of graduate students in that field and 
submitting to the dean of the graduate school recommenda- 
tions not merely for degrees but for rejection and reproof. 
. . . [his year, after the chairman had read a full report be- 
fore the department, in a long evening meeting, the depart- 
ment voted to recommend that a certain list of graduate stu- 
dents be advised, on the basis of their work, particularly in 
seminars, not to continue their work, or not to continue it 
beyond the master’s degree.” This department has just 
adopted a regulation requiring at least a year’s seminar train- 
ing of all first-year men, the effect of which will be to put it 
in a much better position to go further than it went this year 
in extending its “black list.” 

Another department now requires all its beginning graduate 
students to spend about three-quarters of their time in a “‘pro- 
seminar’ in which the entire staff cooperates. On the basis of 
a special examination in each field covered by this pro-seminar 
and a pooling of staff judgment, the department decides whom 
it shall advise not to continue beyond the M.A. stage. One 
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graduate school has adopted a rule providing for a three 
months’ probationary period for all beginning students. Re- 
ports from a number of other institutions indicate that similar 
steps are contemplated with a view to discovering by the end 
of the first year those who really possess the aptitudes requi- 
site to successful advanced study. 

3. Trend Away from Required Course Work.—A third 
noticeable development is the trend away from the imposition 
of minimum course requirements without regard to the needs 
of the individual student. Such measures as optional attend- 
ance on courses, exemption from course examinations and 
elastic credit for research, are here and there in effect, while 
there is under consideration at places the substitution for 
courses of round-table discussion groups, with and without 
staff participation, in the belief that a happier atmosphere for 
independent intellectual effort may be created. 

In general, it may be said that formalized course instruction 
is rapidly growing in disfavor, although practicable curricular 
substitutes have not yet been worked out except in a few 
instances. 

4. Flexible Adaptation of Regulations to Individual Needs. 
—One also discerns efforts on the part of a good many social 
science departments to take stock, more carefully than for- 
merly, of the individual differences of their graduate person- 
nel. This tendency appears, for instance, in the setting-up of 
special advisory committees for each Ph.D. candidate as early 
as his first year of graduate study, and in the institution of 
regular annual conferences with each Ph.D. student at which 
his entire situation is reviewed. 

More suggestive still is the action taken by certain depart- 
ments to relieve from normal requirements exceptionally able 
students, as by excusing from the general examination grad- 
uate students whose work at the undergraduate level was of 
summa cum laude quality or perhaps of high magna cum laude 
quality, provided they had shown promise of research and 
made a creditable record in their first year in the graduate 
school, and provided also that they were pursuing a course of 
studies that would give the same general range of preparation 
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as that required of graduate students taking the oral examina- 
tion, and by substituting directed reading and research for 
courses. Under such a flexible plan, it is possible for a gifted 
student with adequate scholastic background to spend an en- 
tire year or more in research in a specific field. Both the 
“mental hazard” involved in the preliminary examination, and 
the tendency to take too much work of an undergraduate char- 
acter in preparation for it, are removed, so that the first-rate 
student may begin developing research habits without delay. 

Recent curricular reforms in one instance boldly provide 
for complete freedom from course requirements and examina- 
tions, with a minimum requirement of residence. Each student 
is advised in accordance with his individual needs and encour- 
aged early to get acquainted with the materials in fields related 
to his major interest. 

5. “Inter-discipline” Fields of Concentration for the Ph.D. 
—The undermining of rigid requirements is also preparing the 
way for a breaking down of conventional departmental bar- 
riers in regard to areas of study. . . . “Divisional” fields of 
concentration have been established for the Ph.D. whereby 
the degree may be taken, for example, in international rela- 
tions, the community, public administration, crime, industrial 
relations, urbanism, and so on. 

It is submitted that, by and large, such changes in training 
procedures are favorable omens. They suggest a fermenta- 
tion of new ideas and a willingness to break with hardened 
traditions. When they become more generally known, they 
should give encouraging leads to other institutions. But they 
do not yet allow full initiative to the brilliant and original 
individual. Nor, except in one instance, by implication, do 
they sanction the “farming out” of high-class students on re- 
search apprenticeships, as it were, with social, governmental 
or business agencies, or research institutes, so that they may 
live for a time in direct contact with the phenomena and per- 
sonalities of their problem-fields. It is striking, also, that no 
attention appears yet to have been given to alternatives to the 
present form of doctoral dissertation. It seems to be generally 
assumed that the preparation of a single piece of work of 
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rather large dimensions is preferable in all cases and in all 
fields to the doing of two or more smaller pieces of research 
on different problems. 

In the interest of meeting the need of more effective grad- 
uate training for the ablest talent that the social sciences can 
recruit from the colleges, it is to be hoped that an increased 
flexibility will soon spread to all institutions. A definitely 
recognized policy of allowing to students of exceptional re- 
search promise special privileges and exemptions from normal 
requirements is essential to the provision of opportunities 
whereby they may secure the variety of the first-hand expe- 
rience which the committee believes is desirable. For such 
students, consultation with specialists off the campus, access 
to such primary or other materials as are necessary to a fully- 
rounded exploration of the thesis problem, or the carrying on 
of field work in lieu of, or in addition to, work in residence, 
should be facilitated by every feasible means. 

The extent to which opportunities for supervised travel and 
field work can be provided for advanced students depends in 
part upon the availability of funds. Figures of the United 
States Office of Education (Bulletin, 1931, No. 15) indicate 
from three and a half to four million dollars available from 
academic institutions for the subsidization of graduate study. 
On the basis of returns secured by the committee from forty 
American institutions offering work for the Ph.D. degrees, 
an aggregate of slightly over one million dollars, granted in 
1931-32 for graduate fellowships with no return in service to 
the institution, was divided among 1767 persons, with an 
average gross stipend of $585. The seemingly large aggre- 
gate funds used to subsidize study on the graduate level, are 
spread thinly, with the consequence that very few fellowship 
appointments to advanced graduate students enable them to 
work outside the institution, even when they are not restricted 
by the terms of the grants, as in 1694 of the 1767, to study in 
residence. In varying degrees, the problem of affording the 
additional opportunities of training which are desired can be 
met by diverting, concentrating or re-assigning existing funds. 

In the light of the foregoing considerations, it is suggested 
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that university administrations, graduate faculties and non- 
academic organizations interested in the furtherance of social 
research give consideration to the following questions of policy 
in regard to advanced training in the social sciences: 


A. Possible means for the development of graduate school 
regulations and procedures conducive to better research train- 
ing in the social sciences: 

(1) What are the advantages and possibilities of weeding 
out by the end of the first year an increasing proportion of 
those students unfitted for further graduate training? 

(2) Is it desirable to make more rigorous the standards of 
admission to candidacy for the Ph.D. degree, and, if so, what 
means are best suited to this purpose? 

(3) Is it desirable to minimize, as budget conditions per- 
mit, the employment, as part-time teachers, of graduate stu- 
dents while engaged in promising programs of training for 
research? 

(4) Should the release of more time and energy of instruc- 
tional staffs for the supervision of superior students be secured 
by the reduction of the number of formal courses offered both 
at the upper-division college level and in the graduate school? 

(5) Would the setting up of “inter-discipline” fields of 
study for the doctor’s degree, regardless of departmental 
lines, be a desirable and feasible means for improving training 
for pioneer research in the social sciences ? 

(6) Would provision for elastic credit for field work and 
outside consultation in lieu of course or seminar work in resi- 
dence, with the provision of adequate supervision, further the 
research development of the exceptional student? 

(7) To what extent is it possible and desirable to differ- 
entiate the educational treatment of the superior students who 
possess outstanding capacities for research, from those of 
average or below average ability? 

B. Provision of funds for financing advanced graduate 
study, travel and field work: 

(1) Is it desirable and possible to reduce the spread of 
subsidization and thereby make possible a large number of 
liberal fellowship stipends all along the line, but especially 
during the period of preparation of the Ph.D. thesis? 

(2) Is it desirable and possible to provide special grants 
for travel and for field work in connection with significant 
thesis investigations by selected graduate students, either by 
securing new funds or by reassigning funds now used for resi- 
dential fellowships ? 








High School Textbooks in Government 


A Study in Substance of Doctrine 


today than the question of the social sciences in the 

high schools. A Commission of the American His- 
torical Association has been at work on the problem for four 
years, following exploratory and tentative studies covering a 
six-year period. Beard’s “A Charter for the Social Sciences” 
is a first fruit of the commission’s work. The fathers of our 
country, Washington, Jefferson, Franklin, and Madison, were 
all alive to the close relation between education and govern- 
ment by the people. The expansion of the country, the insist- 
ence that public education is a state matter, the growing 
importance of the Federal government and the steadily dimin- 
ishing importance of state government, especially since the 
authorization of the income tax, have of recent years obscured 
in the popular mind this close relationship. The question is 
further complicated by the fact that here the accepted creed 
of science “teach nothing not proven by observation and exper- 
iment except attitude and method”’ comes face to face with the 
practical necessities of life, both the life of the individual and 
the life of organized society. Here the scholarly ideal of 
neutrality is challenged by the ethical ideal of action. Here 
a fictitious world of mechanical energy and physical goods 
comes in contact with a real world of boys and girls. Here 
the American ideal of the freedom of the individual and the 
right of private judgment is challenged by the scientific ideal 
of truth and universal validity of fact for the intelligent. 
Here, likewise, belief in the one truth is challenged by the 
modern notion of “point of view,” and the claims of objective 
absolutes denied in favor of indubitable subjective “‘as-I-like- 
its.” Here naturalists and culturalists wage their unending 
battle, while American parents show the depth of their belief 
in real education by giving their darling daughters full per- 
mission to go swimming so long as they do not go near the 


N« QUESTION is more crucial in American education 
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water. Here education is itself confronted with a question so 
fundamental that the answer education gives will determine 
whether education is to be file clerk and bookkeeper of Amer- 
ican life, or prophet and leader—teacher in the sense the word 
has been understood through the centuries until now. 

The problem of democracy teaching itself about democracy 
is very much like the question of the Church training its own 
leaders. The Church believes leaders should be trained, but 
they must be leaders who will not ask the Church to move 
from Egypt or to break camp at Sinai. Democracy is willing 
the social sciences shall be taught but prefers nothing shall 
be taught which parents have not already assimilated and to 
which the necessary life adjustments have not already been 
made. Bring anything else into the school curriculum and it is 
viewed as propaganda or indoctrination. Parents are willing 
that the schools shall describe the past and picture the world 
as it is. The discerning of the signs of the times, plans for 
tomorrow, preparation for the future society in which the child 
will have to live its life, appraisal and estimate of values, 
orientation of desire—these things the average American feels 
are activities to be reserved for adults. 

If one is interested in the substance of education rather than 
in its material equipment, form of organization or quantity of 
production, and asks what is American education actually 
teaching high school boys and girls regarding government, the 
inquirer will probably be surprised to discover that nobody 
knows. We hope it is not true, as one writer has suggested, 
that the chief function of the teaching of social sciences in the 
high school is to induce the student to unlearn what the ele- 
mentary school has taught him. We know what is taught in 
particular schools, we can generalize about a few states, but 
to attempt generalization regarding the country as a whole is 
dangerous. 

In 25 states the choice of textbooks is left to local authori- 
ties. In 15 states textbooks in government are approved but 
not prescribed. In only 8 states do the state authorities de- 
termine what textbooks in government high schools shall use. 
This is in accord with the American doctrine of self-determina- 
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tion and home rule, but it is rather remarkable that no one, 
so far as I can learn, has been interested enough in the subject 
to make a comprehensive study of how this self-determination 
works out in practice, and what consequently the present gen- 
eration of high school youth is learning about government in 
this critical period of post-war reconstruction. The matter 
has been brought forcibly to my attention in connection with an 
inquiry which I had undertaken to find out what opportunity 
was being given high school students to learn something, for 
example, of that highly controversial subject, the League of 
Nations. I discovered that there was not even a list of text- 
books in government now in use in American high schools 
available, and with the generous help and cordial cooperation 
of the publishers I attempted to collect as many as possible of 
the textbooks now in use and make a digest of the information 
regarding the League of Nations given in the score of books 
more widely used. It appears that there are about a hundred 
and fifty different texts in government named on the lists of 
authorized and prescribed books for high schools of the va- 
rious states. How many other texts are in use locally it would 
be difficult to guess. It was an agreeable surprise to find most 
of the books examined so up-to-date, so enlightened, so much 
in advance of pre-war textbooks. I was impressed by the 
unanimity with which the post-war textbooks have turned 
from the old idea of government as a sacrosanct absolute, not 
subject to the test of human needs and desires, to the homely 
idea of government as a practical device for practical ends to 
be used and changed, continued, expanded, contracted or 
abolished, according to the efficiency with which it serves the 
human purposes it was created to serve. Except in a very 
few books which are survivals of the pre-war period, there is 
no hint of the doctrine of the state as an end in itself, as a 
sovereignty to be judged neither by moral laws nor by tests of 


*The American Association of University Women published in the Proceed- 
ings of its convention held at New Orleans, April 9-12, 1929, the report of a 
special committee (Laura F. Ullrick, Chairman), on Textbooks in U. S. History 
Used in the Schools of the United States. Sixty textbooks in History are re- 
viewed in this report. One of the factors considered by the Committee was the 
attitude of the text toward the World Court and the League of Nations. 
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efficiency. The view of these new books is that government 
is made for man, not man for the government, and it becomes 
evident that democracy understands itself and has at last be- 
come articulate. Such a philosophy of government smooths 
the road to a consideration of the League of Nations. The 
question is not prejudged by any dogma of the inviolability 
of sovereignty. It becomes rather a question whether as indi- 
vidual citizens we have any jobs we want done, any great aims 
to be attained, for which our national machinery is not ade- 
quate. This gives those, who believe a great army and navy 
can keep us out of war, a chance to prove their case from his- 
tory, if they can. It gives the isolationists a chance to show 
how the desires of men are better satisfied if they trade just 
among themselves, stay within their own tariff walls, consume 
their own wheat, wear their own cotton, ride in their own 
automobiles, than if they go exploring and bargaining up and 
down, across and around the world. The prevailing teaching 
brings again to public attention that concept of “the people”’ 
and their reserved powers, written into the Constitution, but 
even greater than the Constitution itself, as the Civil War 
showed and as our present economic dislocation may demon- 
strate again in even wider application. Whether it be wise or 
not, there is no question that our high school boys and girls 
are being given the opportunity to inform themselves regard- 
ing current political problems, and opportunity to discuss 
them, superficially and prematurely perhaps, but more likely 
with greater knowledge and wider vision than their fathers 
and mothers possess when they cast their ballots to determine 
local and national action on these same problems. Of the vital 
significance of this instruction for the individual and for the 
nation there can be no question. Certainly it merits and 
should receive greater attention on the part of the wise than 
has hitherto been given it. As a contribution to this end I 
present herewith a digest of the teaching in some of the text- 
books on the subject in question. 

AMERICAN CITIZENSHIP Practice, by R. V. Harman, H. R. Tucker and 

J. E. Wrench. University Publishing Company, 1931. 


Authorized for use in Kentucky high schools, Nebraska, Texas, Utah 
(as co-basal text for junior high schools) and New York City. 
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Its first chapter, entitled “The Art of Living Together,” begins with the 
statement, “The greatest problem that we have to deal with today is the 
art of living together.” 

Part VII of the book is entitled “America and the World Community,” 
and contains two chapters: Chapter XX XIX, International Relations; 
Chapter XL, American Ideals. The chapter on international relations has 
the following sub-heads: The World Community, The Responsibility of 
America, America’s Relations to Other Nations in the Past, The Cost of 
War, The Development of Arbitration, The League of Nations, Interna- 
tional Law, etc. The chapter is illustrated with good photographs of the 
League of Nations in session, Woodrow Wilson, and the Conference on 
Limitation of Armaments. The suggestive questions attached to the chap- 
ter include: 

1. In what sense may we be said to be living in a world community? 

2. In what sense is America responsible for what is going on in the rest 
of the world? 

5. Why is not the splendid isolation of the United States possible in 
practice? 


8. What arguments have kept the United States from joining the League 
of Nations? 


Tue AMERICAN Democracy. A Text in Government by S. E. Forman. 
Revised Edition. Century Company, 1930. 
Authorized for use in California, in the 9th grade in District of Colum- 
bia, in Kentucky high schools, in Michigan, and New York City. 


Part III of the book is devoted to the functions of the American Govern- 
ment. Chapter 32 of this Part is devoted to a discussion of international 
relations with sub-sections on the Society of Nations and International Law, 
and on the League of Nations. A facsimile is given of the signatures on the 
Treaty renouncing war. 

Questions on the text appended at the end of the Chapter include 

Give an account of the organization and provisions of the League of 
Nations. 

Under suggestive questions and exercises are: 

Give an account of the part played by the United States in the forma- 
tion of the League of Nations. 

Name the countries that are members of the League. Why did we not 
join the League? What has been the history of our attitude toward 
the League? Is it likely that we will ever join it? 


AMERICAN GOVERNMENT. A Consideration of the Problems of Democracy. 
By Frank Abbott Magruder. Allyn and Bacon, 1933. 
Authorized for use in California, Delaware (outside of Wilmington), 
Kansas, Kentucky (basal book), Massachusetts, Michigan, Nebraska, New 
Mexico, Ohio, Oregon, Texas, Utah and New York City. 
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Defines government (page 2) as follows: “A government is the agency 
through which the purposes of a State are formulated and executed... . 
Government is important because through cooperation we are able to main- 
tain peace, security, justice and public services more easily than if individuals 
acted singly.” 

Chapter XXXII of the book is devoted to “Foreign Problems of the 
United States.” These include land and oil problems in Mexico, recent 
developments in Nicaragua, American control in Haiti, the United States 
and the world war debts, the Great Lakes to Atlantic Ocean waterways, 
and the Kellogg-Briand Treaty to outlaw war. The last subject is intro- 
duced by the following statement: 


“Tgnorance, superstition, fear, hate, greed, and other faulty human condi- 
tions and emotions are fundamental causes of wars. Hence education to in- 
form men, to quiet their passions, to develop their sense of cooperative sym- 
pathy, and to develop love and an international mind, will create a desire for 
peace. But changing men’s hearts is a slow process. Meanwhile, after the 
horrors of the last war fade from our memories, the calamity of another war 
may overtake us before the human race is fully converted to a life of peace. 
War might come again and wreck the very educational process in which we 
are engaged before it has time to attain its goal. 

“While human nature cannot be changed by making a new law, yet when 
the influential majority has risen to a will for peace, they can declare peace 
instead of declaring war. Aristide Briand, the French Minister of Foreign 
Affairs, and Frank Kellogg, then American Secretary of State, developed a 
will for peace. Therefore, these officials brought to Paris representatives 
of fifteen world powers, who, on August 27, 1928, signed the following 
Kellogg-Briand Treaty to renounce war.” 


The following statement is made regarding the Permanent Court of Inter- 
national Justice: 


“When two of our forty-eight states have a dispute, they settle it in the 
United States Supreme Court. They never think of settling it by war. An 
international world court has long been the dream of jurists; and in 1921 
the League of Nations set up the Permanent Court of International Justice, 
which holds regular annual sessions at The Hague in the beautiful court- 
house erected through the generosity of Andrew Carnegie.” 


The only reference in the volume to the League of Nations, according to 
the index, is the inclusion in the questions named for discussion at the close 
of Chapter III (which deals with the origin of the Federal Constitution), 
of question five: 


5. Which of the following arguments in favor of a League of Nations 
were also applicable to our thirteen States at the time of their union? 


(a) Steamships are drying up oceans, airplanes are removing mountains, 
and wireless is actually eliminating space; that is, scientific inventions have 
increased the causes of international conflict because nations of different 
religions, customs and languages have been brought together. Steamships 
bring Orientals to the United States, airplanes bring liquor from Mexico, 
and wireless exchanges yellow journal comments before the facts are known. 

(b) Progress is made by cooperation; hence we should not fight but 
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should cooperate with our commercial competitors in developing all back- 
ward countries, and thereby create trade enough for us all. 

(c) Every community that enjoys peace and order has government. The 
township, the county, the state, and the United States of America have peace 
and order because they have governments to secure it. But in the interna- 
tional community, where nations meet to settle their complex relations, just 
as individuals meet in their community, we have had no impartial officers to 
adjust their differences. Public opinion and noble impulse must be organ- 
ized to enforce its will upon the selfish. 


(d) Justice is maintained by impartial laws that are enforced by impartial 
tribunals. 


(e) War takes lives, destroys property, consumes natural resources, and 
hence increases the cost of living. Therefore, we should settle international 
disputes by ballots and not by bullets. 


Among the questions appended to Chapter XXVIII dealing with public 
education is question nine: 


g. Which course is more worthy of public support: one that has resulted 
in the production of non-breakable glass; of rubber from turpentine and 
other American chemicals; of alcohol from natural gas; and of leather, 
silk, photographic films, sausage casings, and cellophane from wood; or a 
course that teaches one to vote unselfishly and unprejudiced; patriotism and 
respect for law; the importance of honesty and love of justice; how to pro- 
mote international justice instead of settling disputes by war; and the phi- 
losophy or religion of happiness? 


AMERICAN GOVERNMENT Topay, by William Bennett Munro. Macmillan, 
1931. 
Authorized for use in California, New Mexico and Ohio. 


In this volume government is defined as the rulership of the people through 
various public officials and bodies. It states “we obey government because 
everybody has needs which cannot be satisfied except by cooperation.” 

Chapter XIV is devoted to foreign problems of national government with 
the subheads America and the League of Nations, American Objections to 
Entering the League of Nations, The Motive Behind the League of Nations, 
Membership in the League, General Organization of the League, The 
League Assembly, The Council of the League, The Secretariat, The Per- 
manent Court of International Justice, The United States and the World 
Court, The American Reservations, The General Work of the League, etc., 
etc. The subjects for debate appended to the chapter are: 

1. That the United States was wise in staying out of the League. 

2. That the maintenance of the Monroe Doctrine involves responsibility 
for the maintenance of order in Latin America. 

3. That the outlawry of war will not suffice to insure world peace. 


AMERICAN Pros_LeMs, by Frances Morehouse and Sybil Fleming Graham. 
Ginn & Co., 1924. 
Prescribed for schools other than five cities of first or second class in 


Utah. 
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Chapter 20 is devoted to foreign relationships. The chapter closes with a 
brief reference to the League of Nations and to the Pact of Paris. 


Tue CitizEN AND THE REPUBLIC, by James Albert Woodburn and Thomas 
Francis Moran. Longmans, Green and Co., 1933. 
Authorized for use in California, Kentucky, Nebraska, Ohio and New 
York City. 


This book, published originally in 1918, has been completely revised. The 
Introduction states “More than half a century ago a United States Senator 
asked from his seat in the Senate, ‘What do we care for abroad?’ If the 
time ever existed it has long since passed by, when America cared nothing 
for ‘abroad.’ Our foreign relations are now of the highest concern to all 
Americans. We have sought in this volume to emphasize this phase of our 
civic life, and to arouse the interest of our High School boys and girls in 
our friendly relations with other nations and in the vital problems of peace 
and war. Our future welfare depends on the way we meet such problems, 
and this is dependent on education.” 

Part V discusses America as a World Power. The box head at the begin- 
ning of Chapter XXI reads: “America’s position in the world has changed 
since the World War. The close of that War left the United States the 
strongest and the most powerful nation in the world. The important ques- 
tion now is: How may this strength and power be used to the best advan- 
tage for all concerned? What should be our attitude toward European 
affairs? Should we join the nations of Europe in an attempt to solve world 
problems or should we attack these problems single-handed and in our own 
way? Shall we join the League of Nations or the World Court? Shall we 
strive for world peace and to promote disarmament? What shall we do 
to prevent another world war? What should be our attitude toward the 
Latin-American States? Should the Monroe Doctrine continue in its 
present form or should it be modified? ‘These and many other questions 
are discussed in the course of this chapter.” 

Five pages are devoted to a description of the League. The statement 
is made “America may yet find it the part of wisdom to depart from its 
traditional policy of isolation. No ‘entangling alliance’ is necessary; with- 
drawal is possible at any time. The necessity of some kind of Society of 
Nations has been generally recognized, since our peace and safety may 
depend upon conditions in Europe.” 

Chapter XXII is devoted to American Ideals in Government. These in- 
clude: The Principles of the Fathers: The Declaration of Independence; 
The Bill of Rights: Muniments of Civil Liberty; Freedom of Religion; 
Obedience to Law and the Rule of the Majority; Universal Education; 
Ideals of Jeffersonian Democracy; Union and Nationality; The Ideal of 
World Peace. The chapter is introduced by the statement “Ideals are very 
real. No one can arrive at any given destination without knowing where he 
is going. The goal should be in sight from the beginning. Our political 
ideals are the goal toward which the nation is striving.” 
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CiT1zENsHIP, by Milton Bennion. With an introduction by David Snedden. 

World Book Company, 1927. 

Prescribed for schools other than five cities of first and second class in 
Utah and authorized for use in California. 

An introduction to social ethics. Chapter XXXVI is devoted to interna- 
tional relations. It discusses international courts of justice but not the 
League of Nations. 


CiTizENsH1IP THROUGH ProgLems, by James B. Edmonson and Arthur 
Dondineau. Macmillan Company, 1931. 
Authorized for use in California, Delaware (outside of Wilmington), 
Kansas, Kentucky, Michigan and New York City. 


This volume begins with a chapter on our dependence on others. In 
Part V, Chapter 26, with the heading “American Ideals and Traditions,” 
devotes a section to our ideals of world relations with the statement “even if 
we wished to keep entirely to ourselves we should not be able to do so,” and 
a section on the League of Nations and world relations. The description of 
the League is incidental and inadequate, and is followed by the Roosevelt 
Creed which concludes with the statement: “I believe we have room for but 
one soul loyalty and that is loyalty to the American people,” followed by the 
statement, “this creed, if generally accepted and practiced, will assure our 
country’s success and permanence.” 


Civit GovERNMENT OF SoUTH CAROLINA AND THE UNITED SrateEs, by 
D. D. Wallace. Southern Publishing Company, Dallas, Texas, 1922. 
Prescribed for use in South Carolina. 


This book does not enter the international field. The concluding chapter, 
however, contains the following statements: 


. . . “We know that a person who cannot cooperate and harmoniously fill 
his place and do his part in the social, economic, religious, political or educa- 
tional tasks of his community is not a god; he is simply not as far advanced 
as his neighbors from the brutishness of primitive barbarism. Such a man or 
woman, boy or girl, needs to learn the lesson that their individual freedom, 
strength, and happiness cannot reach their best development without the 
proper cooperation with others in forgetfulness of what belongs to him or 
her alone.” . . . “Whatever be the form of our organized social life, what- 
ever the framework of our majestic national life, the government of our 
noble State, the activities of the city or village or quiet hillside or valley that 
we love as home, or a world-wide league to enforce peace among all the 
nations of men, they are all sacred and should be made to express our service 
to our common humanity and our duty to God.” 


Community Crvics, by Arthur W. Dunn. D. C. Heath & Company, 1929. 

Prescribed for communities of less than 2,500 people in Alabama (20,000 
pupils). Authorized for use in California and 7th and 8th grades in Ken- 
tucky. 


Community Civics AND Rurat Lirs, by Arthur W. Dunn. D. C. Heath 
& Company, 1929. 
Authorized for use in Ohio. 
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Community Civics ror City ScHoots, by Arthur W. Dunn. D. C. Heath 
& Company, 1928. 


Authorized for use in California, Ohio and New York City. 


These books discuss community problems from the standpoint of the need 
for cooperation in community life. A chapter in each book is devoted to “a 
world community” with sub-sections on the League of Nations, the govern- 
ing organization of the League, the Permanent Court of International 
Justice, the World Court, and The Hague Tribunal. 

Suggestions at the end of the chapter include: 

Debate the question: “Resolved, That the United States Should Enter the 
League of Nations.” 

What are some of the vital questions that have been or are being con- 


sidered by the Council and Assembly of the League of Nations? 
How has the United States made use of the machinery of the League of 


Nations? 
Community Civics, by Howard C. Hill. Ginn & Company, 1928. 
Authorized for use in California, Kansas, Michigan and New York City. 


Chapter I is devoted to the subject “How We Live Together,” with the 
sub-sections, How We Depend on One Another, How We Help One An- 
other, How We Conflict with One Another, How We Control One An- 
other, How You Can Do Your Part. 

Chapter VII is devoted to “Our Neighbors in Other Lands” with the 
quotations: “Science and peace will finally triumph over ignorance and war” 
(Louis Pasteur) ; “Next to the great fact of a Nation’s independence is the 
great fact of its interdependence” (John Hay). 

The Chapter contains four sections: Section 1, “How Nations Depend on 
One Another,” with sub-heads, Independence of Early America, Imports 
of Modern America, Exports of Modern America, International Character 
of Arts and Sciences, and Shrinking of the World. Section 2 discusses 
“War,” with the sub-heads, Team Work among Nations, Conflicts among 
Nations, Causes of War, Modern Warfare, and the Cost of War. Section 
3 is devoted to “Peace,” with the sub-head, “War or Civilization, Which?” 
and sections on International Law, Arbitration, Association of Nations and 
Disarmament. Section 4 is entitled, “What We Can Do To Promote World 
Friendship,” with four sections under the general heading “Good Will”: We 
can try to understand other nations, we can speak well of other countries, we 


can be friendly and courteous to foreigners, and we can use our influence 
for peace. 


Tue DEVELOPMENT OF THE UNITED States, by Wilson Porter Shortridge. 
Macmillan Company, 1929. 
Authorized for use in New York City. 


This is a text in history, rather than in government. Part VI is devoted 
to America and World Affairs during the Period 1917-1929. Chapter 
XXXIII is devoted to the Great War, and Chapter XXXIV to Plans for 
World Cooperation and Peace. Mention of the League is incidental. One 
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sentence refers to it in the past tense: “The League of Nations was a piece 
of political machinery devised to lessen the probability of war. There was 
to be an Assembly for the airing of grievances. There was to be a Per- 
manent Secretariat.” 


EssENTIALS OF AMERICAN GOVERNMENT, by John Mabry Mathews. Ginn 
& Co., 1927. 
Authorized for use in California, Delaware (exclusive of Wilmington), 
Kentucky, Nebraska and New York City. 


Chapter XXXIV is devoted to American foreign relations, and Chapter 
XXXV to the United States and the World. Chapter XX XV has a section 
(322) devoted to the United States and the League of Nations, with a brief 
and inadequate description of the League. 


EveryDAY PropLemMs oF AMERICAN Democracy, by John T. Greenan and 
Albert B. Meredith. Houghton Mifflin Company, 1927. 
Authorized for use in California, Nebraska, North Carolina and Utah. 


The introduction, page xii, states: “Many young people obtain from their 
elementary education the erroneous impression that while others are wrong, 
American institutions are perfect. It is the duty of the secondary school to 
disabuse the pupil of this idea through reflective thinking and the weighing 
of comparative values.” 

Chapter I, Section 1, states: “In a democracy we define government as 
the instrument created to carry out the wishes of the people.” 

Chapter XIV is devoted to a discussion of international relations. Sec- 
tion 1 is devoted to American foreign relations with the sub-heads, How the 
United States Conducts Foreign Relations, The Basis of American Foreign 
Policy, Previous Attempts at World Peace, The League of Nations, The 
Permanent Court of International Justice. Section 2 is devoted to the prob- 
lem, “Ought the United States To Enter the League of Nations?” and sub- 
divided into the presentation of the case why we should enter the League of 
Nations and why we should not enter the League of Nations. Under re- 
search questions and topics appended to the chapter are 


“13. Do the members of your family believe that the United States should 
enter the League of Nations? Find out their reasons. 


“19. Contrast the League Assembly and Council with our Congress. 


“20. If the League had been in existence in 1914, would it have prevented 
the World War?” 


Chapter XXX of the volume is devoted to international commerce. 
ForM AND FuNcTIONS oF AMERICAN GOVERNMENT, by Thomas Harrison 
Reed. World Book Company, 1925. 
Authorized for use in California, Kentucky, Nebraska and Utah. 
This book, revised in 1923, is essentially of the pre-war type. Its point 
of view may be seen from the statement on page one: “The earliest task of 


government, and to this day its most fundamentally important function, is 
that of national defense against foreign aggression.” 
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Chapter XXVII is devoted to foreign relations and national defense. Nine 
pages are devoted to this chapter; three of them are on preparedness. There 
is no adequate description of the organization of the League or its operations. 


Tue FounpDATIONS OF AMERICAN GOVERNMENT, by Herman A, Spindt and 
Frederick Lynne Ryan. D. C. Heath & Company, 1929. 
Authorized for use in California and New York City. 


A textbook in Civics. “The study of how we work together in groups to 
obtain the things we want should be the most interesting of subjects. . . . 
Civics is concerned with the functions of government. What does govern- 
ment do? Civics is concerned with the machinery of government. How did 
we get the form that we now have? Is it a well designed piece of 
machinery ?” 

Chapter 15 is devoted to Foreign Affairs with sub-heads on the United 
States and Foreign Nations, Control of Foreign Policy, Organization of the 
State Department, International Law, Ratification of Treaties, Treaties and 
the Constitution, Foreign Policies of the United States, the Monroe Doc- 
trine, . . . Peace Policies, Arbitration, Disarmament, Outlawing of War, 
International Organization, What Should Be the American Policy, The 
Future of our Foreign Relations. 

Among the projects named at the close of the chapter are: 


Debate the general question of United States membership in a League of 
Nations. 


Debate the questions: 


a. Resolved, That the two Americas should form a League of Nations 
to take the place of the Monroe Doctrine. 


b. Resolved, That an Anglo-American alliance is a better guarantee 
of world peace than the League of Nations. 


c. Resolved, That a policy of splendid isolation is the best policy for 
the United States. 


Chapters 32 and 33 are devoted to Our Neighbors; Chapter 32 to the 
Dominion of Canada; Chapter 33 to Latin America, with the reproduction 
of a cartoon of the National Council for the Prevention of War with the 
slogan, “Neighbors Should Be Friends.” 

Chapter 34 is devoted to the subject of International Organization with 
sections on The Problem of International Justice, International Organiza- 
tion before the War, Formation of the League of Nations, Organization of 
the League, Work of the League, Permanent Court of International Jus- 
tice, United States and the League, and the Kellogg Peace Treaty. 

Questions at the end of the chapter include 


Under what reservations should the United States join the League of 
Nations? 
Has the League done enough to justify its continued existence? 


In case you do not favor the present League of Nations, suggest a sub- 
stitute for it. 


If you favor the League, write an argument in its favor. 
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GovERNMENT AND THE PEopLE, by Joseph Ragland Long. Charles Scrib- 
ner Sons, 1929. 


Authorized for use in California, Nebraska and New York City. 


The last chapter discusses foreign relations of the United States. Wash- 
ington’s Farewell Address and Jefferson’s Inaugural Address are quoted 
with regard to permanent and entangling alliances, with the statement, “the 
Government of the United States has always adhered to the policy laid down 
by Washington and reaffirmed by Jefferson.” There is no description of the 
League of Nations. The establishment of the Permanent Court of Inter- 
national Justice is mentioned in a footnote. 


GovERNMENT IN THE Unitep States. A Textbook for High Schools. By 
Henry L. Smith, Sheldon E. Davis and Clarence H. McClure. Laidlaw 
Brothers, 1928. 


Prescribed for use in Florida (7,000 students) and Virginia (60,000 
students). 

Authorized for use in California, Indiana, Kansas, Kentucky, Mississippi, 
New Mexico, Oklahoma, Oregon. 


Treats the institutions and practices of government as “extensions of indi- 
vidual standards, ideals and ambitions. Traditions, customs and laws reflect 
prevailing self-controls. What the individual is or admires, he wishes laws 
to guide or compel others to be or admire. The services which modern gov- 
ernments undertake in such variety and volume are those which individuals 
would perform for themselves, but which are more satisfactorily and eco- 
nomically secured through cooperation in government.” 

Throughout the volume the fact is emphasized that successful operation 
of the external agencies of government rests upon the complementary inner 
controls of the individual. Problems which individuals cannot solve for 
themselves are not solved with the institutions of government except by 
right attitudes and intelligent cooperation. A related emphasis is placed upon 
the fact that effective government can be developed only in response to 
human needs. 

Chapter XVIII, entitled “Governmental Service, Past and Present,” pre- 
sents the gradual expansion of the theory and the services of representative 
government in the United States since 1800. 

This chapter contains the following statement regarding the League of 
Nations: 


“ 


An important argument for the support of the War in America 
had been ‘this is a war to end all war,’ and many people of the world were 
expecting the statesmen assembled at the peace congress to provide some kind 
of plan for arbitrating disputes among nations. 

“The conference provided a written constitution for a League of Nations 
and incorporated it in the treaty of peace. A League of Nations was formed, 
and regular meetings of the council and assembly of the League have been 
held at Geneva since that time. A World Court has been established, and 
many conferences for the discussion of special international problems such as 
reparations, adjustment of boundaries, and naval disarmament have been held. 
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“The amazing developments in communication, transportation, and trade 
have brought the nations of the world into such close relations with each 
other that many problems which were national or local problems in the days 
of Thomas Jefferson are now of concern to the entire world. The most 
fundamental task of all is the discovery of some means of preventing war. 
Under modern conditions any misunderstanding which threatens to result in 
war immediately becomes a world problem. The world is still hoping for 
improvement of international law. The world viewpoint is gradually replac- 
ing the narrow and sometimes selfish one of national advantage through the 
increased use of special administrative bureaus for handling matters of con- 
cern to two or more nations, the improvement of the League of Nations and 
the World Court, the handling of international problems through established 
departments, and the further development of national consular service.” 


Chapter XXXII is devoted to a discussion of international relations. The 
chapter opens with the following statement: 


“The Importance of Our Relations with Other Nations: The establish- 
ment of peace and amity with other nations of the world, the increasing of 
commerce, and the securing of more markets for surplus products are 
national problems whose significance can hardly be overestimated. The im- 
portance of friendly relations with other nations and of the effect of such 
relations upon our internal affairs is seldom realized by our citizens, except 
in such times of crisis as the World War. We are sometimes told that the 
United States is self-sufficient, and that we can get along without inter- 
course with other people; some of our citizens have even come to believe 
that dealings with other nations will be beneficial to those nations only, and 
injurious to us. However, we know that a foreign market for our surplus 
raw and manufactured products is essential to our prosperity; that any 
reasonably fair exchange of goods is beneficial to both parties; and that under 
modern conditions of communication and transportation we could not, if we 
would, sever our relations with other nations.” 


It discusses the policy of isolation and its origin, and devotes a section 
(f, page 538) to the League of Nations, the World Court, and Isolation. 
The section concludes with the statement “to the careful student who reads 
the chapter in this book on industry, transportation, communication and com- 
merce, the difficulties which the United States must encounter in holding to 
the policy of isolation will be apparent.” 

Under the sub-head, “Our Present Foreign Problems,” the chapter dis- 


cusses the war debt, the problem of permanent peace and the problem of 
the World Court. 


Tue History or MANKIND, by Hutton Webster. D. C. Heath & Com- 
pany, 1928. 
Authorized for use in Louisiana as a basal book, and in North Carolina. 


Chapter 18 is devoted to international relations. Section 168 describes 
the cost of the World War in money and human life. Section 169 is devoted 
to the peace movement through the centuries, and section 170 to international 
organizations; section 171 to the League of Nations and the World Court, 
with illustrations of the Peace Palace at The Hague and a good view of 
Geneva. Section 172 is devoted to disarmament and the abolition of war. 

The list of suggested studies at the end of the chapter include 
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8. Explain the present organization and functions of the League of 
Nations. 


9g. Why did not the United States join the League of Nations? 


‘ 10. Compare the World Court with the Supreme Court of the United 
tates. 


11. Compare the abolition of private warfare toward the close of the 
middle ages with the recent movements to abolish public warfare. 

12. “The way to obtain peace is to prepare for war.” Does this state- 
ment seem to be justified by the experience of European peoples during the 
last half century? Is it truer to say: “The way to obtain peace is to pre- 
pare for peace?” 

INTERNATIONAL Civics, by Pitman B. Potter and Roscoe L. West. Mac- 

millan Company, 1930. 

Authorized for use in California, Nebraska and New York City. 


The introduction to this text states “the day has long since passed when a 
man, family or nation can live alone... . “A man of the twentieth century 
is indeed a world citizen.” Of the fifteen chapters, three chapters are de- 
voted to the League of Nations: Chapter XII, Origin; Chapter XIII, Struc- 
ture; Chapter XIV, Activities. The chapters are illustrated with photo- 
graphs of the Assembly and Council in session, and of the buildings used by 
the League. Other chapters deal with International Intercourse, Inter- 
national Politics, International Law, International Courts, Commissions and 
Conferences, International Federation, Alliances and Concerts, Enforce- 
ment of International Authority, and Peace. 


NATIONAL GOVERNMENTS AND INTERNATIONAL RELATIONS, by Frank Ab- 
bott Magruder. Allyn and Bacon, 1932. 


Authorized for use in California, the District of Columbia and New 
York City. 


This is a notable text in a field which is new to high school textbooks. As 
stated in the preface, “the inspiration for this text was the desire to spread 
knowledge of international problems to a wider circle and the belief that 
such knowledge will discourage another conflict which would hang another 
hundred billion dollar debt around the necks of our children.” 

The book begins with a chapter on How the United States Conducts Her 
Foreign Affairs, devotes twenty chapters to as many countries, including 
territories and dependencies of the United States, and adds chapters on In- 
ternational Law, Immigration, Causes of International Wars, World War, 
Reparations and Debts, Proposed Methods of Preventing International 
Wars, the League of Nations, the World Court. The Appendix gives a copy 
of the Covenant of the League of Nations. The chapter on the League 
covers thirty pages and is well illustrated. It gives a complete statement of 
the organization and activities of the League, perhaps the most complete to 
be found in a high school text. 


Tue New Civics, by Roscoe Lewis Ashley. Macmillan, 1930. 
Authorized for use in California, Michigan, Nebraska, New Hampshire, 
Ohio, and New York City. 
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This volume is divided into three parts: The Citizen and Society, Ameri- 
can Democratic Government, Public Activities and Problems. The third 
part, Chapter XXIV, deals with foreign relations, subdivided into foreign 
commerce and national defense, and Chapter X XV deals with international 
problems and policies, subdivided into world power and American policy, 
past, present and future. 

Section 360 (page 483) is devoted to a very inadequate discussion of the 
League of Nations, The general standpoint of the book may be judged by 
the statement on page 470 under the heading, “National Defense”: 


“Since events of recent years have proved that international faith is kept 
no better among modern civilized nations than it was a century or two ago, 
we must not be blinded by our desire for peace, by our determination to keep 
peace, or by the establishment of peace conferences and courts such as those 
at The Hague, the League of Nations and the Court of International Arbi- 
tration. Events since 1914 prove that in case of a great international con- 


flict it is not easy for the most peaceable neutral, even at a distance, to keep 
out of war,” 


and by the statement on page 483: 


“A world power must have prestige. A business man who has gained a 
reputation either for his firm or for a particular kind of goods can outsell his 
competitors and possibly drive them from the market. A nation that has the 
name of getting what it wants, of carrying through a policy which it starts, 
or of always playing fair, will, by virtue of that reputation, win out over its 
competitors, other things being equal. If a new country, such as the United 
States of America, is to gain the first world position, it must depend upon 
its commanding position or upon its limitless resources. Because America is 
larger and has more natural resources than her European rivals, and, in addi- 
tion, occupies the most commanding position on the globe—that between the 
Atlantic and Pacific Oceans—she should be the foremost world power of 
the future.” 

Our Communiry Lire, by Clyde L. King and J. Lynn Barnard. John C. 

Winston Co., 1932. 

Authorized for use in California, Ohio, Oklahoma, Tennessee, Utah (co- 
basal text for junior high schools). 


Under the general heading of Part II, “Government at Work,” Chapter 
21 is devoted to the subject, “We Work with Other Countries.” This chap- 
ter contains sections on the prevention of war, international arbitration, the 
League of Nations, the World Court, and outlawing war. 


Our GovernMENT, Its Nature, Structure, and Functions, by James Wil- 
ford Garner and Louise Irving Capen. American Book Company, 1932. 
Authorized for use in California, New Mexico, Tennessee and New York 

City. 

This volume defines government (page 1) as “a select group of citizens 
who serve us by making and executing the laws necessary for the good order 
and happiness of the community, State, or Nation, and who do for us many 
things which our common interests require to be done but which we cannot 
do acting singly as individuals.” 
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Chapter XXIX (pages 602-624) is devoted to the subject “The United 
States and Other Nations.” The chapter opens with the statement: 


“Our country is a part, a very important part, of the great world in which 
we dwell. We do not live alone, isolated and detached from the other 
nations. As one of our great Presidents said: ‘We are participants, whether 
we would or not, in the life of the world. The interests of all nations are 
our own also. We are partners with the rest. What affects mankind is 
inevitably our affair as well as the affair of Europe and Asia.’ ” 

After a discussion of American isolation versus cooperation, international 
relations and interdependence, the United States as a world power, the sys- 
tem of international law, disputes between nations, methods of settling 
international disputes, the section is devoted to the League of Nations, open- 
ing with the statement, “what many persons regard as the crowning achieve- 
ment of the nations acting in cooperation was the establishment of the 
League of Nations.” A section is also devoted to the outlawry of war. The 
questions appended to the chapter and the topics for discussion, report and 
debate deal largely with the League of Nations. 


PrincipLes oF SociraL Science. A Survey of Problems in American 


Democracy, by Thames Ross Williamson and Edgar Bruce Wesley. 
D. C. Heath & Co., 1932. 


Authorized for use in California. 


This book undertakes to answer questions about the world in which we 
live. Part I deals with the Approach to Problems; Part II, American Eco- 
nomic Problems; Part III, American Social Problems; Part IV, American 
Political Problems; Part V, General Problems. 

Chapter XX XVII in Part V is devoted to international relations and in- 
cludes a discussion of the League of Nations, its organization, aims, present 
status and the relations of the United States to the League. The problems at 
the end of the chapter include: “Trace the development of the idea of the 
League of Nations,” “Survey an instance of how the League works,” “To 
join or not to join.” A copy of the complete Covenant of the League of 
Nations is printed in the Appendix along with the Constitution of the United 
States. 


PropLEMS IN AMERICAN Democracy, by Thames Ross Williamson. D. C. 

Heath & Co., 1925. 

Prescribed as supplementary text for schools other than five cities of first 
or second class in Utah. 

Authorized for use in California, Nebraska, North Carolina, Oklahoma, 
Tennessee and New York City. 


Is divided into five parts: Part I, Foundations of American Democracy; 
Part II, American Economic Problems; Part III, American Social Prob- 
lems; Part IV, American Political Problems; Part V, The Mechanism of 
Government. 

Part IV, Chapter 39, is devoted to The Nature of International Relations 
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and Chapter 40 to The Improvement of International Relations. The sub- 
heads of Chapter 40 are: The Policy of Isolation Is No Longer Sound; 
The Monroe Doctrine Not a Solution; Necessity of International Organi- 
zation; The Hague Conferences; Grave Defect of The Hague Tribunal; 
The League of Nations; Organization of the League of Nations; Aims of 
the League of Nations; The United States Refuses To Join the League; 
American Objections to the League of Nations; The Present Status of the 
League of Nations; The Outlook. The chapter closes with the statement: 


“The struggle for permanent peace is the struggle of intelligence against 
brute instinct, the struggle of generosity against selfishness, the struggle of 
sympathetic understanding against suspicion and vanity and jealousy. In 
proportion as the nations of the earth win this many-sided struggle against 
their anti-social traits, we shall move toward permanent peace. The road 
may be a long one, but is it not a road, and are we not moving forward 


upon it?” 

The subjects for discussion attached to the chapter include arguments in 
favor of the League of Nations, arguments opposed to the League of 
Nations, were our objections to the League justified, to what extent did 
politics enter our rejection of the League of Nations. 


ProBLEMS OF AMERICAN Democracy, by R. O. Hughes. Allyn and Bacon, 

1932. 

Prescribed for use in communities of less than 2,500 people in Alabama 
(8,000 pupils) ; supplementary text for schools in other than five cities of 
first and second class in Utah. Authorized for use in California, Nebraska, 
North Carolina and 3rd and 4th year students in Tennessee (3,350 pupils). 


This book considers not only problems of government but also “questions 
of social and industrial relationships which are in every way as vital as any 
questions of government.” The problems are arranged under the general 
headings: Foundations, Making America Intelligent, Elevating American 
Standards, Making America Prosperous, Making Our Democratic Govern- 
ment Efficient, Our Relations with Other Countries, The America To Be. 

Under the next to last head, Chapter XXVI is devoted to Establishing 
Sound Principles of International Conduct; XXVII, Determining the 
Fundamentals of our Foreign Policy; XXVIII, Promoting International 
Cooperation and Good Will. Chapter XXVIII includes a section on Mili- 
tarism, Wisdom or Folly; a section on Peaceful Settlements Between 
Nations; a section on the League of Nations; How Far Can We Hope 
To Go?; America’s Opportunity. The chapter concludes with the statement: 


“The great need of the world is better understanding and less selfishness 
among nations. The reduction of armaments is both sound economy and 
sound ethics. International cooperation, through international association 
and conference should be cultivated as an important means of bringing peace 
and good will.” 


ProBLEMS OF AMERICAN Democracy, Political, Economic, Social, by Henry 
Reed Burch and S. Howard Patterson. Macmillan, 1929. 
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Authorized for use in California, Delaware (outside of Wilmington), 
Nebraska, North Carolina, Ohio. 


International relations are not discussed in this volume except incidentally. 
It devotes Chapter XXIII to the subject of the regulation of international 
trade, and the last section of Chapter IX on a Century of Political Evolu- 
tion, to the World War, with the statement: 


“The cessation of hostilities, however, did not remove the foreign situation 
from American politics. ‘Splendid Isolation’ seems no longer possible but 
we shrink from active participation in European affairs. Sound and patriotic 
nationalism must be the true basis of friendly international relations.” 

Tue Ruee Soctat Science Course, by Harold Rugg. Ginn & Company, 

1929-1932. 

I. An Introduction to American Civilization. 
II. Changing Civilizations in the Modern World. 

III. A History of American Civilization. 

IV. A History of American Government and Culture. 

V. Introduction to Problems of American Culture. 

VI. Changing Governments and Changing Cultures. 

Prescribed for schools of Delaware, outside city of Wilmington. 

I, II, and V, authorized for use in New York City. 

II. Authorized for grades 8-9 in Kentucky. 


This series of reading books, with their accompanying work books of 
directed study, aims to introduce the pupil to world civilizations and their 
history. The purpose of this unified course in the social studies is to intro- 
duce young people to the chief conditions and problems which will confront 
them as citizens of the world. It attempts to combine, in one general course, 
facts and subjects generally treated in separate courses of history, geography, 
and civics. While written primarily for Americans, with emphasis on 
American problems and conditions, the perspective is world wide. 

The final unit of the first volume is devoted to the subject Interde- 
pendence in the Modern World. The second volume discusses Foreign 
Civilizations, including, England, France, Germany, Russia, China, Japan, 
and Latin and South America. In volume four, Chapter 29, International 
Problems of the American Government are discussed, including the ques- 
tions: Should the United States Join the League of Nations?; The Briand- 
Kellogg Peace Pact; Should the United States Take Part in the World 
Court?; and Are the Fundamental Problems of International Relations 
Being Solved? The sub-title of volume six is The World’s March toward 
Democracy. The concluding chapter, XXV, is devoted to the subject, 
“World Conflict Versus World Organization,” with attempts at inventories 
of the achievements and weaknesses of modern civilization. It includes a 
section entitled A Fragile World Society of Interdependent Nations. There 
is another section on The Chief Sources of Unrest in Europe Today; sec- 
tions on The Imperative Need for International Cooperation and Control; 
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Some Earlier Proposals To Organize the World for Peace; A Dream Come 
True: The League of Nations; How the League of Nations Is Organized; 
What Is the Nature of the League’s Work? The Problems Summed Up: 
Organizing the World for Security. 


SoctaL Civics, Our Democracy AND Its Prosiems, by William Bennett 
Munro. Macmillan Company, 1931. 
Authorized for use in Tennessee. 


The book discusses first The American Environment, then The Organiza- 
tion of Government, and third, Civic Activities. Civic Activities is sub- 
divided into Economic, Social and International. The international section 
has five chapters: XXVIII, National Defense; X XIX, Foreign Relations; 
XXX, The United States as a World Power; XXXI, The United States 
and the League; XXXII, Some Problems of World Democracy. 

The chapter on the League of Nations has sub-heads: What War Has 
Meant in History, The Folly of It, Desire To End War, The Origin of 
the League, Was Its Establishment Wise?, The Balance of Power, The 
Framing of the Covenant, The League as a Scheme of Government, The 
League’s Deliberative Organs, etc., etc. 

Appended to the chapter on the League is an excellent bibliography. 


SoctaAL Prostems. A Study of Present Day Social Conditions, by Ezra 
Thayer Towne. Macmillan Company, 1932. 
Prescribed as supplementary text for schools other than five cities of first 
or second class of Utah. 


This is a work on social problems rather than on government. 

Chapter XVII is devoted to the subject of conservation of human life 
with a sub-section on the peace movement, beginning with the statement: 
“most people feel that all this work involved in conservation of our human 
resources is of little avail if at any time we may have another great war. . . . 
Our ability to save people from disease is not very helpful if we only save 
them to be shot a little later on the battlefield. . . . The League of Nations 
is the one permanent official organization which we have to deal with the 
causes and prevention of war.” 


TEACHING THE CHILD Patriotism, by Kate Upson Clark. The Page Com- 
pany, 1918. 
Authorized for use in Utah. 


Contains the statement: “Pasteur defined democracy as ‘that form of gov- 
ernment which permits every individual citizen to develop himself to do his 
best for the common good.’ We must come to recognize that ‘common 
good’ means not only the good of our own nation but that of the world. 
May not Pasteur’s definition be used as a basis for the great democratic 


principle to which we look forward as the security for the peace of the 
world?” 
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You anp Your GoveRNMENT. A Textbook on Community Life and Con- 
stitutional Government, by Chester C. Maxey, Professor of Political 
Science, Whitman College, Washington. D.C. Heath & Company, 1931. 
Authorized for use in California and New York City. 


This book makes an effort to interpret constitutional government in terms 
of community life, and community life in terms of constitutional govern- 
ment. The book devotes an entire chapter to the subject of world citizen- 
ship (pages 532-557). It discusses: 


1. The Nature of International Society with the sub-heads, Patriotism and 
Nationality, Armed Patriotism, Why Nations Quarrel. 

2. The Causes of International Conflict, under the sub-heads, Boundaries 
and Territory, Race and Religion, Economic Rivalry, Protection of Citizens, 
Jingoism. 

3. The Settlement of International Disputes with the sub-heads, War as a 
Means of Settlement, The Dilemma of the Peace Loving Citizen, Why We 
All Tolerate War, Peaceable Modes of Settlement, Negotiation, Shortcom- 
ings of Negotiation, Arbitration, The Shortcomings of Arbitration, What 
Must Be Done To Make Peaceable Settlement Successful. 

4. International Law, with the sub-heads, Why We Need International 
Law, and The Making of International Law. 

5. International Administrative Machinery, with the sub-heads, “Why We 
Need International Administrative Machinery, International Unions, The 
Shortcomings of International Unions. 

6. International Judicial Machinery, with the sub-heads, Why We Need 
International Courts and Present International Tribunals. 

7. The League of Nations, with the sub-heads, The Membership of the 
League, The Organs of the League, The Assembly, The Council, The 
Secretariat, Permanent Commissions, The International Labor Organization, 
The Permanent Court of International Justice, How the League Promotes 
Peace. 

8. Disarmament and Renunciation of War, with the sub-heads, The 
Washington and London Conferences, the Briand-Kellogg Pact. 

9. World Citizenship, with the sub-head, The Need of a Broader View. 
The last paragraph contains the statement “the person who would be a good 
citizen in this day of world events and world intercourse must think in inter- 
national as well as in national terms, for the time has come when every man 
has a duty to the world as well as to his own country.” 


In the list of Little Adventures in Civic Thinking appended to the chapter, 
question four is: “Resolved, That the United States should join the League 
of Nations. Debate the foregoing question.” Under things to discuss 
attached to the chapter, number six is “name the organs of the League of 
Nations and describe the leading functions of each.” Number seven is “by 
what means does the League of Nations strive to promote peace?” 

The chapter is illustrated with admirable pictures of the Peace Palace at 
The Hague, the Palace of the League of Nations at Geneva, a view of the 
Assembly of the League of Nations in session, a view of the Judges of the 
World Court in session, and a photograph of the American delegation to the 
London Conference. 


Joun H. MAcCRAcKEN. 
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The 1932 Psychological Examination 


HE number of colleges that have sent in records on the 

1932 Psychological Examination of the American Coun- 

cil on Education exceeds the number of any previous year. 
As of March 1, 1932, the number of institutions that had 
ordered the 1931 edition was 377, and a total of 165,341 
examinations had been sent out. At the same time reports 
had been received from 152 colleges giving the scores of 
41,369 students. By the corresponding date of March 1 this 
year, 389 institutions had ordered 134,773 copies of the ex- 
amination. The present report contains norms based on the 
records of 43,384 students sent in by 205 colleges. A com- 
parison of these figures shows that the freshman enrollment in 
the colleges is somewhat lower than in the previous year. 
Colleges ordered more exactly the number of tests they needed 
and there were fewer large orders of several thousand tests 
to be used for research purposes. 

This report contains norms for the 1932 edition of the 
Psychological Examination. Tabulations have been made of 
all scores reported by March tenth. The list of colleges send- 
ing in records is given below. The table also shows the 
number of records reported from each college and the first 
quartile, median, and third quartile for the gross scores from 
each college. About thirty of the colleges are marked with 
an asterisk. That indicates medians and quartiles which may 
be somewhat lower than the true norms for those colleges 
because we were not sure that the artificial language test was 
scored for correct answers in both columns. Letters were sent 
to all colleges reporting scores to inquire whether the artificial 
language test was so scored. In a very large majority it had 
been so scored. A few colleges did not want to rescore those 
tests on account of the expense involved. Some of the colleges 
which are starred felt that their scores would be only slightly 
changed and some did not respond. We have assumed, there- 
fore, that their true scores may be slightly higher than their 
reported scores and have indicated them so. The colleges will 
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themselves know whether to add a few points to the reported 
medians to obtain the true medians. 

Following the list of colleges are the frequency distributions 
for the five separate tests and for the gross scores. 


UNIVERSITIES AND COLLEGES SUBMITTING TEST RECORDS 


Number of 
students Q: 

Adelphi College, Garden City, N. Y.. 112 163.33 

Akron, University of; Akron, Ohio.. 380 124.29 

Alabama College, Montevallo, Ala... 258 99.70 
Alabama Polytechnic Institute, Au- 

ena ne ee 358 97.88 
*Alberta Normal School, Edmonton, 

EE ute esci se coe nat cal 248 156.15 
*Alberta, University of; Edmonton, 

III i. 61h Kern c ened Sik Lasid.a 364 164.00 
Albion College, Albion, Mich....... 193 130.13 
*Alfred University, Alfred, N.Y... . 198 135.59 
Allegheny College, Meadville, Pa.... 209 133.54 
*American University, Washington, 

ft Serr reer re rs 119 154.69 
Antioch College, Yellow Springs, Ohio 129 201.79 
Arizona, University of; Tucson, Ariz. 361 121.81 
Arkansas, State A. and M. College, 

pa ee Pee ee 187 98.44 
Baker University, Baldwin, Kans.... 98 129.17 
Bates College, Lewiston, Me...... 207 142.50 
Bay City Jr. College, Bay City, Mich. 197 132.50 
Baylor University, Waco, Tex.. 300 92.08 
Belhaven College, Jackson, Miss..... 68 114.00 
Bennett College for Women, Greens- 

Reus» ook cua eh esas: 81 62.50 
Birmingham- Southern | College, Bir- 

ee eee 225 107.59 
Bishop’s University, Lennoxville, 

I eds Eas wie en ern: oak 48 136.67 
Blackburn College, Carlinville, Ill.... 138 125.00 
Bowdoin College, Brunswick, Me.. 156 178.00 
Bradley ee Institute, Peoria, 

Til. TRsaLt as me vale 217 (127.74 
Briar Cliff Jr. "College, ‘Sioux City, 

Driv oh dias oer ye a 4 25 116.25 
Brigham Young University, Provo, 

a Foe oe ere 430 101.45 

*Broadview College, La Grange, II. 94 102.50 
Bucknell University, Lewisburg, Pa.. 271 145.15 


Median 


197.50 
158.38 
124.14 


128.05 
196.37 


201.11 
159.63 
162.00 
175.93 


199.38 
234.33 
154.35 


130.75 
155.71 
186.07 
171.67 
129.50 
146.00 


78.33 
139.58 
175.00 
155.71 
214.12 
162.82 
161.70 
134.28 


136.67 
181.31 


Gross Scores 


230.00 
194.17 
151.25 


169.06 
232.78 


236.00 
188.58 
202.50 
214.17 


239.25 
260.94 
197.96 


170.50 
185.00 
226.62 
212.12 
169.48 
182.00 


102.50 
174.42 
223.33 
186.50 
236.47 
195.23 


199.17 


169.80 
176.11 
216.63 











Number of 
students Q: 
Buffalo, University of; Buffalo, N.Y. 268 141.05 
California, State Teachers College at 
WM es 6 bWue nd a OO Lew cesses 261 99.03 
State Teachers College at Fresno.. 459 92.38 
*State Teachers College at San Jose 148 101.43 
*State Teachers College at Santa 
arr err 201 112.17 
Carleton College, Northfield, Minn.. 292 155.62 
Carroll College, Helena, Mont...... 56 122.50 
Case School of Applied Science, Cleve- 
land, Ohio yrases ineaeee 162 166.25 
Centenary College of "Louisiana, 
oe Sree ee 166 97.30 
Central College, Fayette, Mo. 202 103.33 
Central State Teachers College, 
Mount Pleasant, Mich.......... 254 115.42 
*Central Wesleyan College, Warren- 
es MN a bss we ean as xa Oe 33 = 86.25 
Central Y. M. C. A., Chicago, Il. 235 107.63 
Chicago, University of; Chicago, Ill. 679 178.82 
Chicago Jr. College, Chicago, Ill.... 68 117.14 
Clark University, Worcester, Mass... 93 151.79 
*Coe College, Cedar Rapids, Iowa... 241 112.95 
Colby College, Waterville, Me...... 172 143.33 
*Colgate University, Hamilton, N. Y. 283 150.47 
Colorado State Teachers College, 
a er 449 120.64 
Colorado, University of; Boulder, 
Be Leh wie Pe eeea PT ee kewes 651 139.20 
Connecticut College for Women, New 
fe VY ee eee 211 139.03 
Cotner College, Lincoln, Nebr. 51 101.88 
Dartmouth College, Hanover, N. H. 634 178.22 
*Delaware, University of; Newark, 
ee et eet oe 253 131.62 
De Pauw University, Greencastle, 
Aer cree 517 146.77 
Detroit, College of City, Detroit, 
oS ee See 480 146.00 
Dickinson College, Carlisle, Pa. 192 131.00 
*Drew University, Madison, N. J.... 43 176.88 
Duke University, Durham, N. C.... 619 114.80 
Earlham College, Richmond, Ind.... 145 123.25 
*Elizabethtown College, Elizabeth- 
i eee! 41 90.83 
Elmhurst College, ‘Elmhurst, Til. 78 133.00 
Elmira College, Elmira, N. eae 89 170.62 
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136.43 
127.83 
137.50 


154.69 
190.83 
161.43 


200.00 


123.53 
137.14 


148.57 


117.50 
147.10 
218.78 
140.00 
179.55 
151.75 
181.58 
188.25 


152.39 
177.32 


171.73 
145.00 
210.22 


165.48 
185.40 


181.43 
167.85 
198.33 
151.98 
171.85 


117.50 
172.86 
203.12 


185 


Gross Scores 
Median 


176.54 


Qs 
216.88 


176.96 
169.60 
180.00 


195.63 
227.59 
210.00 


237.31 


158.63 
181.88 


191.15 


167.50 
193.54 
256.01 
200.00 
225.50 
184.22 
215.00 
227.74 


189.50 
216.94 
197.26 
187.42 
248.32 
205.63 
224.08 
214.14 
211.43 
228.13 


190.35 
205.66 


182.50 
208.33 
233.50 
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Number of 
students Q: 
Emory Jr. College, Oxford, Ga..... 56 80.00 
Emory University, Emory University, 

x Chai SE. cE gt 155 108.50 

Emporia, College of; Emporia, Kans. 113 120.16 
*Eureka College, Eureka, Ill......... 58 105.00 
*Evansville College, Evansville, Ind. 130 108.50 

Fenn College Y. M. C. A., Cleveland, 

Meee P9091. Sa Sed... S2o00. 98 145.83 
Florida State College for Women, Tal- 

a eee. 631 116.81 
Florida, University of; Gainesville, 

ee ee eee 661 105.30 
Frances Shimer Jr. College, Mt. Car- 

We Meee iG iis 78 129.00 
Franklin College, Franklin, Ind..... 119 107.19 
Fullerton Jr. College, Fullerton, Cal. 422 124.60 
Geneva College, Beaver Falls, Pa.... 169 124.06 
Georgia State Woman’s College, Val- 

ns SOs. Sabine cies ott 163 79.85 
Georgian Court College, Lakewood, 

OAD Gii3.. nuit 41 178.75 
Gettysburg College, Gettysburg, Pa. 141 102.50 
Goshen College, Goshen, Ind....... 68 96.00 
Goucher College, Baltimore, Md.... 2315 t7h.75 
Graceland College, Lamoni, Iowa... 65 105.63 
Grinnell College, Grinnell, Iowa.... 210 140.88 

*Hampden-Sydney College, Hampden- 

er er 107 112.12 
Hanover College, Hanover, Ind..... 141 114.64 
Haverford College, Haverford, Pa... 91 219.64 
Hobart College, Geneva, N. Y...... 95 149.72 

*Hood College, Frederick, Md....... 135 112.19 
Huron College, Huron, S. Dak...... 69 134.50 
Idaho, College of; Caldwell, Idaho.. 133 104.64 
Idaho, University of; Moscow, Idaho 378 111.75 
Idaho, University of; Pocatello, Idaho 390 107.38 
Illinois College, Jacksonville, Ill.... 146 121.88 
Illinois, University of; Urbana, Ill... 1688 126.03 
Immaculata College, Immaculata, Pa. 43 175.83 
Judson College, Marion, Ala........ 77 —- 98.93 
Junior College of Connecticut, Bridge- 

RCT. GOI S.. Ridits. ccah 89 132.50 
Kalamazoo College, Kalamazoo, 

BS 5k Wed. eo wres swoon 90 161.93 
Kansas City Jr. College, Kansas City, 

es 05s Si OG Fak Bai oso cca 660 142.95 
Kenyon College, Gambier, Ohio. . 52 165.71 


Median 
115.00 


147.73 
154.37 
160.00 
141.11 


176.15 
152.75 
142.81 


176.00 
151.85 
156.36 
164.23 


108.21 


201.67 
143.00 
136.00 
204.77 
138.75 
182.00 


141.25 
149.00 
249.55 
180.55 
150.50 
165.83 
143.75 
145.63 
148.15 
164.00 
164.05 
207.50 
134.17 


165.00 
181.82 


177.45 
203.33 





Gross Scores 


Qs 
155.00 


205.25 
213.75 
202.50 
176.25 


211.00 
190.36 
186.29 


214.17 
190.50 
195.83 
200.53 


142.04 


227.82 
179.80 
180.00 
229.30 
179.50 
222.50 


192.50 
199.50 
280.31 
210.42 
183.61 
199.50 
177.92 
183.27 
192.27 
198.33 
205.17 
251.56 
177.82 


199.50 
218.17 


215.25 
236.67 





i i —_ 






























Number of 
students Q: 

Keuka College, Keuka Park, N.Y... 53 160.62 
La Salle College, Philadelphia, Pa... 104 98.57 
*La Verne College, La Verne, Cal..... 33 102.50 
Lawrence College, Appleton, Wis.... 56 138.33 
*Lehigh University, Bethlehem, Pa... 333 171.16 
Lindenwood College, St. Charles, Mo. 159 119.72 
Loretto Heights College, Loretto, 

I ea eee re 29 130.83 
*Lynchburg College, Lynchburg, Va. 84 84.00 
Lyons Twp. Jr. College, La Grange, 

ere ee, Pere 143 127.82 
MacMurray College, Jacksonville, Ill. 132 130.00 
Maryland State Normal School, Tow- 

EN oan aciucica ns aie 238 141.39 
Maryland, University of; College 

Bs. MUIR iiethss Simeone antes 554 124.79 
Marymount College, Salina, Kans... 36 144.00 
Maryville College, Maryville, Tenn. 262 117.93 
Marywood College, Scranton, Pa.... 120 146.67 
Massachusetts Agricultural College, 

ee ee eee 301 162.39 
McPherson College, McPherson, 

BN Biales CAREER RES s o:9,0 5 74 113.75 
Milton College, Milton, Wis....... 31 111.88 
Minnesota, State Teachers College at 

Ee See 524 108.00 

State Teachers College at Winona. 201 126.61 
Missouri Valley College, Marshall, . 
er eer eS ee 81 90.63 
*Montana, State University of; Mis- 
Ee ee eee 411 113.37 
*Moravian Seminary and College for 

Women, Bethlehem, Pa......... 23 
Morningside College, Sioux City, 

ND: 5 ose state Shand 186 105.69 
Morton, J. Sterling, Jr. College, Ci- 

aS See) eee 392 123.04 
Mount Mercy College, Pittsburgh, Pa. 44 115.00 
Mount Saint Joseph College, W est 

Hartford, Conn.... 55 137.82 
*Mount Saint Joseph College, ‘Phila- 

Rs. Dbck 6: 8adn niet shining 46 145.00 
Mount Saint Vincent, College of; 

3} SO er ener 122 158.33 
Muhlenberg College, Allentown, Pa. 114 107.00 


Nebraska, University of; Lincoln, 
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Gross Scores 


Median 


196.43 
141.11 
138.75 
183.33 
199.10 
155.77 


159.00 
114.22 


170.45 
170.00 


174.74 
162.59 
178.00 
150.53 
167.33 
195.00 


160.00 
145.00 


142.79 
159.68 


131.00 
151.00 
205.00 
140.00 


156.53 
156.00 


183.57 
187.50 


184.54 
146.00 


165.48 


187 


235.83 
182.50 
177.50 
216.67 
233.19 
191.39 


188.75 
170.00 


207.50 
207.50 


205.32 
199.84 
210.00 
196.33 
200.00 
227.38 


192.50 
184.17 


176.43 
190.68 


159.72 
190.10 


177.22 


201.43 
196.66 


210.31 
225.00 


214.09 
198.13 
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Number of 
students Q: 
New Hampshire, University of; Dur- 

BN ECs oh ac wt ', 453 134.43 
New Mexico State Teachers College, 

Silver City, N. Mex............ 76 108.57 
New Mexico, University of; Albu- 

eR EE es is. 270 107.92 
North Central College, Naperville, Ill. 140 115.71 
Northwestern University, Evanston, 

Pa CANES 6 cde een 931 168.53 
Notre Dame College, South Euclid, 

RN ee PSE SN ues cee ss 40 135.00 
Oberlin College, Oberlin, Ohio. ..... 295 182.63 
Olivet College, Olivet, Mich........ 44 140.00 
Oregon Normal School, Monmouth, 

RS acti. Lddia sss o5Gs ee 287 115.60 

*Oregon State Agricultural College, 

a ory 562 113.62 
Oregon, University of; Eugene, Ore. 502 120.50 
Pacific University, Forest Grove, Ore. 60 127.27 
Park College, Parkville, Mo........ 175 132.34 
Parsons College, Fairfield, Iowa..... 131 125.94 
Pennsylvania, State Teachers College 

ee SE ee 374 123.97 
Phillips University, Enid, Okla...... 132 107.50 
Pomona College, Claremont, Cal.... 178 156.58 
Port Huron Jr. College, Port Huron, 

BM sc ') . Sav Sth cateeeaee 111 125.36 
Rhode Island State College, King- 

eer ree: oe eee 340 110.00 
Rochester, University of; Rochester, 

PAPO Ea ee CT CES ime Reant ies 336 176.48 
Rochester, University of, School of 

Nursing, Rochester, N. see 39 139.38 
Rollins College, Winter Park, Fla... 131 137.50 
Rosary College, River Forest, Ill.... 116 117.14 
Rosemont College, Rosemont, Pa... 66 165.00 
Russell Sage College, Troy, N. Y.... 106 146.82 
Saint Catherine, College of; St. Paul, 

| is 5k, se Py dow eee. TOR. 171 139.16 
Saint Elizabeth, College of; Convent 

atte TE. Bes cas 0.04 axe: * 86 128.33 
Saint Joseph’s Mercy Hospital, Au- 

EY Fibs oN aioe» s Sows geen, ,! 13 
St. Mary’s College and Academy, 

Notre Dame, Ind.............. 45 120.83 
St. Olaf College, Northfield, Minn... 224 130.48 

*St. Paul-Luther College, St. Paul, 
BL aisndd exee ws eeaedaseeune 51 117.92 


Median 


168.57 
150.00 


143.33 
157.27 


201.64 
176.67 
217.05 
166.67 
150.88 
149.11 
154.62 
165.00 
170.39 
167.86 
155.92 
148.00 
191.54 
157.86 
162.38 
210.42 
167.50 
173.61 
147.50 
200.00 
182.00 
168.60 
180.00 
137.50 


157.50 
167.13 


146.43 





Gross Scores 


Qs 
208.33 
178.75 


182.06 
212.22 


234.01 
210.00 
252.63 
210.00 
181.73 
185.47 
195.57 
206.00 
202.50 
202.95 
191.32 
188.56 
231.25 
198.13 
196.25 
247.00 
210.83 
211.39 
190.00 
229.00 
219.17 
203.75 


230.55 


192.50 
212.00 


196.25 








Number of 
students Qs: 
St. Vincent College, Latrobe, Pa.... 71 115.28 
Saint Xavier College for Women, Chi- 
WG ME! oc URNS coke a0 voce wt 80 158.33 
*Salem College, Winston-Salem, N.C. 87 102.19 
Santa Rosa Jr. College, Santa Rosa, 
ER PP se 210 115.50 
Seattle Pacific College, Seattle, Wash. 102 118.33 
*Seton Hill College, Greensburg, Pa... 73 143.13 
Simmons College, Boston, Mass..... 289 166.83 
Southern Methodist University, Dal- 
Se, “Ug Pere ess sc ess 389 133.66 
Southwestern College, Winfield, Kans. 134 108.75 
Southwestern Louisiana Institute, La- 
eI se 348 = =72.22 
Spring Hill College, Springhill, Ala. 77 ~=—- 86.87 
*Syracuse University, Syracuse, N. Y. 545 149.40 
Texas, A. and M. College, College 
Station, BO: Lanoattewet ce 619 96.03 
*Texas State College for Women, Den- 
A, Tice. dice cnmaesuics «. 351 107.22 
Texas Technological College, Lub- 
i ee eee 701 100.00 
) Trinity College, Hartford, Conn.... 140 181.67 
Trinity College, Washington, D. C. 84 145.71 
Tulsa, University of; Tulsa, Okla... 150 115.00 
Tusculum College, Greenville, Tenn. 89 98.13 
; Vanderbilt University, Nashville, 
PP er eee eeent See 234 136.50 
5 Vermont, University of; Burlington, 
Te Or ae ee 312 141.67 
0 Virginia Polytechnic Institute, Blacks- 
Ee Serer 325 99.36 
3 Virginia Union University, Rich- 
9 ee eee 97 65.42 
0 Washburn College, Topeka, Kans... 200 129.23 
0 Washington College, Chestertown, 
7 Pere eee | Se 93 106.94 
Washington School of Physical Edu- 
5 cation, Washington, D. C....... 6 
Washington, State College of; Pull- 
15 i err ee 361 113.63 
Washington and Jefferson College, 
WHE, MRSS sss ce wes 141 108.75 
Washington and Lee University, Lex- 
50 eee Wis. ss canis mente 264 99.44 
00 *Webster College,Webster Groves,Mo. 70 98.75 
Wells College, Aurora, N. Y........ 71 «191.25 
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193.33 
145.00 


152.50 
148.00 
182.50 
203.00 


165.96 
143.00 


98.63 
109.17 
185.28 
132.17 
138.83 
128.83 
210.00 
189.00 
155.55 
121.88 
175.71 
178.50 
128.14 


95.63 
163.57 


135.00 
200.00 
143.98 
147.86 
141.43 


138.33 
223.57 


189 


Gross Scores 
Median 


148.75 


Qs 
202.50 


228.00 
183.21 


189.00 
185.83 
222.50 
233.02 


211.71 
169.56 


133.00 
166.88 
223.54 
169.80 
173.63 
158.35 
252.50 
223.33 
205.00 
159.17 
223.75 
204.74 
175.23 


129.64 
202.22 


159.38 


183.55 


189.64 


179.09 
189.00 
253.13 
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Number of Gross Scores 
students Q: Median Qs 

*Western State Teachers College, Kala- 
mazoo, Mich 507 112.39 139.88 177.89 
Westminster College, Fulton, Mo.... 85 122.50 162.14 193.50 

Westminster College, New Wilming- 
225 132.50 167.92 200.68 

West Virginia University, Morgan- 
town, W. Va 280 114.74 152.31 191.67 
*Wheaton College, Wheaton, Ill 219 134.75 170.42 213.03 
*Wichita, University of; Wichita,Kans. 396 120.37 154.24 193.89 
Willamette University, Salem, Ore... 153 140.89 173.89 206.14 
William Smith College, Geneva, N.Y. 49 150.62 185.00 212.50 
William Woods College, Fulton, Mo. 107 105.28 156.43 197.08 
Wilson College, Chambersburg, Pa... 127 163.66 193.89 231.88 
*Yankton College, Yankton, S. Dak... 84 116.67 145.71 184.29 
Y. M. C. A. 23rd St. New York,N.Y. 36 112.50 152.00 175.00 
York College, York, Nebr 122.50 168.75 195.42 


Completion Test 
Norms based on the records of 20,491 students in 80 colleges. 


Scores Frequency Percentile Scores Frequency Percentile 
0 62 .001 42 673 .839 
2 118 .006 44 578 .870 
4 194 .013 46 459 895 
6 333 .026 48 388 .916 
8 472 .046 50 362 .934 

10 597 .072 52 282 .950 
12 719 .104 54 241 .963 
14 887 143 56 152 .972 
16 984 189 58 .979 
18 1080 239 60 985 
20 1133 293 62 .990 
22 1122 348 64 .993 
24 1180 405 66 .996 
26 1142 461 68 .997 
28 1168 518 70 .998 
30 1081 572 72 .999 
32 1063 625 74 .999 
34 1008 675 .999 
36 899 722 .999 
38 873 .765 3 
40 749 805 

Lower Quartile 

Median 

Upper Quartile 


* Yale University sent in records for 158 students, a sampling of about one-fifth 
of the class. Mr. Burnham wrote that he believed it to be a representative sam- 
pling of the whole class. The median gross score for the sampling was 244.56. 





Norms based on records of 32,881 students in 127 colleges. 


Scores 
0- 2 
3- 5 
6- 8 
9-11 
12-14 
15-17 
18-20 
21-23 
24-26 
27-29 
30-32 
33-35 
36-38 
39-41 
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Artificial Language Test 


Frequency Percentile 


428 
203 
571 
513 
621 
856 
1310 
1652 
1957 
2190 
2202 
2166 
2104 
1852 


.006 
.016 
.028 
044 
062 
.084 
117 
162 
217 
.280 
347 
413 
478 
538 


Lower Quartile... 


Median ..... 


Upper Quartile... 


Scores 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 
81-83 


Analogies Test 
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Frequency Percentile 


1677 
1582 
1707 
1594 
1388 
1149 
1135 
1011 
689 
682 
604 
568 
373 
97 


Norms based on records of 20,484 students in 80 colleges. 


Scores 
0 
2 
4 
6 
8 

10 
12 
14 
16 
18 
20 
22 
24 
26 
28 
30 


Frequency Percentile 


420 
514 
670 
764 
804 
692 
593 
509 
471 
488 
556 
643 
751 
889 
991 
1080 


.010 
033 
062 
.097 
135 
172 
.203 
.230 
254 
277 
303 
332 
366 
406 
452 
502 


Lower Quartile. ... 
Median ........ 
Upper Quartile 


Scores 
32 
34 
36 
38 
40 
42 
44 
46 
48 
50 
52 
54 
56 
58 
60 


15.66 
29.90 
38.61 


592 
641 
691 
742 
787 
826 
.860 
893 
919 
.940 
.959 
977 
991 
.998 


Frequency Percentile 


1137 
1184 
1234 
1205 
1119 
1009 
868 
656 
530 
327 
199 
116 
47 
18 


557 
613 
.672 
732 
789 
.840 
886 
.923 
952 
973 
.986 
.994 
.998 
.999 
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Arithmetic Test 


Norms based on records of 20,414 students in 80 colleges. 


Scores Frequency Percentile Scores Frequency Percentile 
113 .003 44 1604 .798 
294 .013 48 1189 .867 
561 .034 52 820 .916 
813 .067 56 505 .948 

1225 117 60 324 .969 
1637 187 64 213 .982 
2006 .276 68 137 .990 
2195 379 72 73 .996 
2424 493 76 42 .998 
2249 .607 80 10 .999 
1980 711 


Lower Quartile 
Median 
Upper Quartile. ... 


Opposites Test 


Norms based on records of 20,486 students in 80 colleges. 


Scores Frequency Percentile Scores Frequency Percentile 
0 271 .007 42 1178 566 
3 176 O17 45 1149 .623 
6 289 .029 48 1094 .678 
9 376 .045 51 1015 .729 

12 569 .068 54 968 .778 
15 653 .098 57 848 822 
18 762 132 60 809 .863 
21 923 174 63 679 899 
24 1000 .220 66 597 .930 
27 1147 273 69 421 955 
30 1160 329 72 340 .973 
33 1217 387 75 228 .987 
36 1206 446 78 121 .996 
39 1267 .507 23 .999 


Lower Quartile. ... 
Median . 
Upper Quartile 
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Gross Scores 


Norms based on records of 36,665 students in 173 colleges. 


Scores Frequency Percentile Scores Frequency Percentile 
0- 9 1 .000 190-199 1968 .693 

10- 19 13 .000 200-209 1881 745 
20- 29 44 .001 210-219 1766 795 
30- 39 112 .003 220-229 1500 .840 
40- 49 224 .008 230-239 1270 877 
50- 59 388 .016 240-249 967 .908 
60- 69 617 .030 250-259 851 .933 
70- 79 927 .051 260-269 656 .953 
80- 89 1153 .079 270-279 460 .968 
90- 99 1401 114 280-289 323 .979 
100-109 1635 155 290-299 239 .987 
110-119 1931 .204 300-309 153 .992 
120-129 2100 259 310-319 94 .995 
130-139 2301 319 320-329 56 .997 
140-149 2314 382 330-339 40 .999 
150-159 2287 A445 340-349 14 .999 
160-169 2379 .508 350-359 7 .999 
170-179 2343 573 360-369 3 .999 
180-189 2247 .635 

Lower Quartile...... 123.43 

eee 163.72 

Upper Quartile...... 205.92 


EQUIVALENCE OF SUCCESSIVE EDITIONS 


For several years the successive editions of the Psycho- 
logical Examination have been comparable in difficulty, but a 
few changes in the 1932 test have resulted in scores not 
directly comparable to last year’s edition. The difference 
between the gross score norms for the 1931 and 1932 gross 
scores does not, however, represent the difference in difficulty 
between the two examinations. This is because of a selective 
factor in the colleges sending in records. Last year 152 col- 
leges sent in scores. If these are divided into four groups of 
38 colleges each, we find the following variation in the number 
of colleges from the different quarters of the distribution 
reporting scores this year. 
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Reporting 1932 


Scores 
Highest quarter (38 colleges)............... 35 
Second - _ EEO, PRS 30 
Third ” " mg gi alias ak vs Aa 28 
Lowest z= eee. oo eee. 20 


These figures show a marked tendency for the colleges with 
highest scores to continue sending in their records and for the 
colleges with lowest scores to stop reporting. This factor 
may be in part compensated by the kind of new colleges send- 
ing in records each year. 

We have made a comparison of the records of 100 colleges 
which reported scores for both the 1931 and 1932 editions 
of the test. On the basis of this comparison we have prepared 
a table of equivalent scores for the two tests. This table is 
presented below. It shows that scores in the 1932 edition 
run, on the whole, about twelve points higher than on the 
1931 edition. The table is based on the records of 26,433 
students in 100 colleges in 1931 and the records of 23,387 
students in the same 100 colleges in 1932. 


Equivalent Scores for 1931 and 1932 Editions 


Score in Score in Score in Score in 
Percentile 1931 1932 Percentile 1931 1932 

rank Edition Edition rank Edition Edition 

1 44 50 20 104 

2 53 61 21 106 119 
3 60 67 22 108 120 
4 64 72 23 110 122 
5 68 76 24 112 124 
6 72 80 25 114 126 
7 74 84 26 115 128 
8 77 87 27 117 129 
9 80 91 28 119 131 
10 82 94 29 121 133 
11 85 96 30 122 134 
12 88 99 31 124 136 
13 90 102 32 126 138 
14 92 104 33 127 139 
15 94 106 34 129 141 
16 96 109 35 130 142 
17 98 111 36 132 144 
18 100 113 37 133 146 


19 102 115 38 135 147 
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Equivalent Scores for 1931 and 1932 Editions—(Continued) 


Score in Score in Score in Score in 
Percentile 1931 1932 Percentile 1931 1932 

rank Edition Edition rank Edition Edition 
39 137 149 70 187 199 
40 138 150 71 188 201 
41 140 152 72 190 203 
42 141 154 73 192 205 
43 143 155 74 194 206 
44 144 157 75 196 208 
45 146 159 76 198 210 
46 147 160 77 200 212 
47 149 162 78 202 214 
48 150 163 79 204 216 
49 152 165 80 206 218 
50 154 166 81 209 220 
| 51 155 168 82 211 222 
52 157 169 83 213 225 
53 158 171 84 216 227 
54 160 172 85 218 229 
55 162 174 86 221 232 
56 163 176 87 224 235 
’ 57 165 177 88 227 238 
58 166 179 89 230 240 
59 168 180 90 233 244 
60 170 182 91 236 247 
61 171 183 92 240 251 
62 173 185 93 244 255 
63 175 187 94 248 259 
, 64 176 188 95 253 264 
65 178 190 96 259 270 
66 180 192 97 267 277 
67 181 193 98 276 287 
68 183 195 99 290 301 

69 185 197 


We can now see whether our total group of cases reported 
for the 1932 test is superior to the group reported for the 
1931 test. The following tabulation makes the answer clear. 


eemian of total gromp 1961 Webs. co. see. hee 147,37 
Median of 100 colleges 1931 test.................000.0 005. 153.72 
TET ee eee 163.72 


Median of 100 colleges (same) 1932 test........... 


Since the group of 100 colleges exceeded the total group in 
1931 more than they exceeded the total group in 1932, we 
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conclude that one factor contributing to a higher median gross 
score on the 1932 test is a selective factor among the colleges 
reporting. 

More important, however, is the probability that the indi- 
vidual colleges are raising their entrance requirements and 
their course requirements so that they are selecting better and 
better students each year. Such a conclusion cannot be based 
on the obtained norms alone, but other evidence seems to 
indicate that such is the case. 

It is also possible that the present (or recent) economic 
depression has been a factor contributing to the selection of 
better college students. College enrollments have decreased 
and it is possible that those least fitted for college work are 
the ones who do not go. 

There is, however, a difference between the examinations 
which is not due to any of the influences just discussed but 
rather to a difference in difficulty between the two examina- 
tions. The following table gives the medians for each of the 
separate tests in the two editions. 


Test 1931 Median 1932 Median 
MG cwe nad bP lon irda 27.62 28.36 
Artificial Language .................. 38.53 30.81 
Analogies ......... | re ; 29.90 29.08 
Arithmetic ......... EN Pas bas 32.25 21.00 
Opposites ....... Cre) Sere yer 38.67 33.62 


The largest differences are for the artificial language test 
and for the arithmetic test. A chance factor which occurred 
in the 1932 edition of the artificial language test is probably 
largely responsible for the difference in that test and will be 
eliminated in the 1933 edition. The 1931 arithmetic test 
gave a median score somewhat lower than in previous years. 
The present distribution of the arithmetic test is considered 
better and the 1933 edition will be planned to be like the 
1932 test. 


HIGH SCHOOLS USING THE EXAMINATION 


Each year an increasing number of high schools administer 
the test to their seniors. We have had requests for norms on 
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high school students but have not had a sufficiently large num- 
ber of scores reported from high schools to justify the prepa- 
ration of norms. A recent publication of the Educational 
Records Bureau of New York City presents a very complete 
report on the use of the examination in the schools which it 
serves. The title of the bulletin is “‘Measurement of Aca- 
demic Aptitude and Reading in Independent Schools.” It 
was prepared by Eleanor Perry Wood. 

L. L. THURSTONE, 

THELMA GWINN THURSTONE, 

The University of Chicago. 








Achievement Tests in the Social Studies 


more than in any other field of instruction, has been 

characterized by serious disagreements concerning ulti- 
mate objectives. Further confusion has resulted from the fail- 
ure to make proposed objectives meaningful by describing them 
in explicit terms, as well as from the failure to provide specific 
instructional materials which have been definitely related to 
or organized for the effective attainment of such objectives as 
have been suggested. In the light of this situation, it is not 
surprising that the general achievement tests now being con- 
structed for the social studies have recently been subjected to 
widespread criticism. 

The test technician has been seriously handicapped by the 
confused state of the curriculum, and as a result the tests pre- 
pared have often failed to perform their proper function as 
effectively as they might. Most of the criticisms raised against 
the general achievement test, however, have not been directed 
at its failure to fulfill its legitimate purpose; rather they have 
been founded upon a lack of understanding of the distinctive 
function of a general achievement test. Because of its tech- 
nical nature, there are many things which a test of the general 
achievement type cannot do, and among these are certain 
things which it is now criticized for not doing. Also, because 
of other considerations, there are many things which it as 
definitely should not attempt to do, and again it has been 
criticized for not doing these things. What is needed, there- 
fore, is a clear understanding, on the part of all concerned, of 
the technical limitations of a test of the general achievement 
type, and a more adequate appreciation of the precise func- 
tions which, in view of these inherent limitations, it may rea- 
sonably be expected to perform. Once these functions and 
limitations are clearly understood, many of the criticisms now 
directed against the general achievement test will lose their 
point, or will more properly be directed elsewhere. 

The general achievement test has been criticized, in some 


oman making in the social studies, perhaps 
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instances, because it has not provided for the measurement of 
“desirable emotionalized attitudes, ideals, and modes of be- 
havior.” This article will attempt to show that, while tests 
are needed for the measurement and description of such at- 
tributes, their measurement cannot be made a function of the 
general achievement test. Again, the general achievement 
test has been criticized because it has been “too exclusively 
limited to the testing of information and to the testing of 
understanding at too low a level.” While this criticism has 
been justified to some degree, it will be shown that the specific 
content of the general achievement test not only should be 
restricted to what should be learned but further should be re- 
stricted to what has been learned; that many things which 
should be learned, but have not been, should not be tested in 
such examinations; and that general achievement tests must 
continue to include a large proportion of items which test only 
for the learning of simple facts and for understanding at a low 
level. In still other instances, the general achievement test 
has been criticized because its content basis has been derived 
principally from analyses of current textbooks and courses of 
study, and because it has not “reflected recent advances’ in 
curriculum construction. The use of a content basis thus de- 
rived will be shown to be a matter of necessity as well as of 
choice, and will perhaps characterize general achievement tests 
for some time to come. Further, the general achievement 
test has been criticized because it has little or no diagnostic 
value and cannot be used to discover gaps in learning or de- 
ficiencies in teaching and in local courses of study. This article 
will show that the functions of diagnosis and curriculum evalu- 
ation and of the measurement of general achievement cannot 
be effectively combined in a single test. 

Many of the present criticisms of the general achievement 
test arise, therefore, from a mistaken attempt to hold it re- 
sponsible for too many types of measurement, and from 
failure to recognize that validity in a test is specific rather 
than general. If a test is to be made most valid for one pur- 
pose, its validity for other purposes must often be sacrificed. 
An “all purpose” test can perform none of its many purposes 
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effectively. Each of the functions mentioned in the preceding 
paragraph, if they are to be most effectively performed, must 
be performed by separate tests or types of tests. 

The purposes of this article, then, are as follows: First, to 
define as explicitly as possible the particular functions which 
may best be performed by tests of the general achievement 
type; second, to show how the general achievement test in the 
social studies must be constructed if it is to perform these 
functions most effectively; third, to show why a test of this 
type cannot be made to fulfill other measurement purposes 
without detracting from its validity with reference to those 
functions which are distinctive to it; and, finally, to present a 
detailed description of a test of this type and to illustrate con- 
cretely its more important characteristics. 

Since these problems or purposes may best be considered in 
the order indicated, it will be necessary, in the earlier sections 
of the article, to assume or to recognize certain limitations in 
the function of the general achievement test before the neces- 
sity for these limitations has been clearly indicated. For this 
reason, the reader may find that some of the restrictions im- 
posed may at first appear arbitrary or even undesirable. He 
is requested, therefore, to accept these restrictions at their 
face value until the necessity for them has been established, 
and to reserve final judgment at any point until the complete 
case has been considered. 

Certain other limitations in the scope of this article should 
also be made clear at this point. For present purposes, the 
writers are concerned only with general achievement tests of 
the type that are intended for widespread use, such as stand- 
ardized achievement tests or those used in nation-wide or 
regional testing programs. This necessitates a further limita- 
tion to tests of the objective type, since only tests of this type 
are practicable for use in such programs or for the provision 
of comparable measures of achievement from school to school. 
Finally, this article is primarily concerned with tests intended 
for use at the secondary school level, and then only in the 
social studies. Many of the statements made will apply 
equally well to other tests without these qualifications, but no 
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attempt will be made to defend what will be said on the basis 
of general applicability. For the sake of simplicity and 
brevity in presentation, these qualifications will not later be 
repeated. Wherever the term “general achievement test” is 
used, however, these qualifications are to be understood by the 
reader. 


THE SPECIFIC FUNCTIONS OF A GENERAL ACHIEVEMENT TEST 


External Characteristics —A general achievement test is 
one designed to express, in terms of a single score, a pupil's 
relative achievement in a general field of subject matter. 

Whether or not this definition corresponds exactly to exist- 
ing popular notions is a matter of little concern. It is the con- 
cept itself that is of significance, rather than the name which 
may be given to it. It is undoubtedly true that this statement 
describes in general terms the great majority of tests which 
have been called “‘general achievement tests,” and that there 
has been little if any disagreement upon the general character- 
istics of this type of examination. Most tests of this name 
have been of the single score type, all of them have attempted 
to measure relative rather than absolute achievement, and all 
of them have recognized subject matter boundaries in one 
form or another. In discussing “general achievement tests” 
as thus defined and as previously qualified, therefore, we are 
not creating any radically new concept, nor are we evading the 
issue by excluding by definition any of the tests which have 
been criticized in the ways indicated earlier in this article. 

The major source of misunderstandings, then, has been a 
lack of agreement upon specific rather than general meanings, 
or a failure to recognize the proper and possible function of 
these tests rather than a failure to agree upon their external 
form. It is the terms ‘“‘achievement”’ and “subject matter” as 
used in this definition which are first in need of clarification. 
What the meaning of these terms cannot include in reference 
to tests of this type will be considered later. 

The Meaning of “Subject Matter’ and “Achievement.”’— 
The term “subject matter,” as it applies in general achieve- 
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ment testing in the social studies is taken to imply only those 
organized ideas, generalizations, concepts, related informa- 
tion and the like, which “‘belong” to the general “field” in ques- 
tion. The term “achievement,” in so far as it refers to what 
may be measured in a general achievement test, refers only to 
rational experiences, including verbal memory and meaningful 
learning of the “subject matter” involved, and the develop- 
ment of a reasoned understanding of or insight into that sub- 
ject matter. This restriction to rational experiences to the 
exclusion of emotionalized attitudes, ideals, etc., will later be 
shown to be unavoidable because of technical considerations, 
as well as desirable and necessary for other reasons. 

The extent of the “field” of subject matter is, of course, 
largely a matter of arbitrary definition. For example, it may 
be taken to include all of the social studies, or it may be limited 
to history alone, or it may include only the history of the 
United States. For the purposes of achievement testing, how- 
ever, the meaning of “field” of subject matter is ordinarily 
subject to two definite types of restrictions. 

In the first place, what “‘belongs’’ to any given field of sub- 
ject matter must be left to the specialist in that field. The 
subject matter of history, e.g., is taken to include only those 
ideas, generalizations, etc., which are the distinctive concern 
of historians in their role as social scientists. The distinctive 
concern of history as a social study is only with those mate- 
rials (meaning ideas, generalizations, information, etc.) which 
it is believed will contribute to a better understanding of the 
nature, function and development of certain human institu- 
tions and practices—political, economic, social and civic— 
which will result in a clearer insight into current political, eco- 
nomic, social and civic problems. 

The second restriction upon the meaning of “‘field of subject 
matter” as applied in educational achievement testing is that 
imposed by the ultimate purposes of general education. The 
field of history, even in the restricted sense already indicated, 
is far too inclusive and indefinite to provide a practicable and 
desirable basis for achievement test construction. Obviously 
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the historian legitimately may be concerned with many detailed 
problems which neither can nor should be included in a pro- 
gram of formal education intended for the general develop- 
ment of the individual who has no highly specialized or voca- 
tional interest in history. The subject matter of history, as 
far as the process of general education and therefore as far as 
achievement testing is concerned, is further limited to those 
selected materials which recognized authorities believe will 
best contribute to a realization of the ultimate objectives of a 
general education. 

The Need for Authoritative and Specific Descriptions of 
Subject Matter.—lIn order to construct a valid and generally 
acceptable test, the test constructor must have before him an 
authoritative and specific description of the subject matter to 
be tested. Descriptions which have either one, but not both, 
of these characteristics are almost equally valueless. An 
achievement test is a collection of specific items dealing with 
specific materials. No single test item can test directly and by 
itself for the attainment of an ultimate objective. Ultimate 
objectives only represent convenient ways of describing imme- 
diate and more specific objectives collectively, and are tested 
only indirectly by testing for the attainment of these specific 
objectives. The materials used in testing for the attainment 
of immediate objectives are identical with, or highly similar 
to, the materials used in teaching to attain those objectives. 
Some one, either the test builder or the curriculum maker, 
must break down the ultimate objectives into immediate and 
specific objectives, and must prepare specific instructional ma- 
terials for them, before construction of test items becomes at 
all possible. It is of little value for the test builder to know, 
e.g., that the ultimate objective of the social studies is “to 
develop better citizens, and well-rounded and cultured indi- 
viduals,” and that the intermediate objective is “to develop in 
the pupil a reasoned understanding of and insight into the 
nature, function and evolution of institutions and practices 
and problems,” unless, or until, he is told what specific items 
of related information, what specific relationships, and what 
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specific ideas, generalizations, broad concepts, etc., constitute 
the accepted subject matter of instruction. Neither is it of 
much value to him to receive such suggestions for the content 
of test items unless he has some reason to believe that this 
content will be generally accepted as belonging to the subject 
matter involved, i.e., unless it is described authoritatively. 
The only authoritative sources of such specific descriptions of 
content which have thus far been made available to the test 
constructor are the textbooks and courses of study now being 
used in instruction. It is inevitable, therefore, that present 
achievement tests will follow closely the content of the best of 
present textbooks and courses of study, not because this con- 
tent is that which ought (presumably) to be taught, but rather 
because it is the only content which thus far has been described 
in a form sufficiently specific, meaningful and authoritative to 
make test construction possible. 

Certainly the preparation of materials of this character is 
the responsibility of the social scientist and the curriculum 
maker, and not of the achievement test constructor as such. 
The process of test construction has become far too technical 
to hope to find combined in the same person, not only the tech- 
nical skill and information pertaining to test construction, but 
also the thorough understanding of subject matter and of cur- 
riculum objectives, all of which are required for good test 
building. The distinction between the test technician and the 
curriculum builder or subject matter expert is by no means arti- 
ficial or insignificant, and a corresponding distinction should 
be made between their respective responsibilities. In the pres- 
ent situation, interestingly enough, the test technician is being 
criticized by the social scientist and the curriculum maker for 
failure to do the very job which they (in other situations) 
admit is their unique responsibility and which they have thus 
far failed to perform! 

The General Achievement Test and Evaluation of Courses 
of Study.—The preceding discussion does not imply, of course, 
that the subject matter basis of any and all tests in the social 
studies must necessarily conform to the content of formal 
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courses of study or of school subjects as they are now organ- 
ized. If specific descriptions of an improved subject matter 
were made available, it might for certain purposes be desir- 
able to construct and to use tests based upon this improved 
content, regardless of the extent to which it had penetrated 
into actual practice. Let us suppose that a test of this char- 
acter, differing significantly in content and organization of 
content from those of present instruction, were constructed 
and used in a nationwide or regional standardized testing pro- 
gram. ‘The differences in test performance on this examina- 
tion between pupils and classes of pupils from school to school 
would be a function, not only of the extent to which pupils are 
learning whatever they are being given a reasonable oppor- 
tunity to learn, but also of the extent to which the local courses 
of study conform in content and organization to that on which 
the test was based. The single total score earned on such a 
test would be an unanalyzable composite measure of several 
factors in which the effect of the “inadequacy” of the local 
course of study could not be isolated. It would nevertheless 
be useful to have tests of this character, but they would be 
tests of the diagnostic type on which the total or composite 
score would have little significance, rather than tests of the 
general achievement type. Certainly it would be important to 
know, in any given school, if present instruction is failing to 
achieve certain desired results, or what are the specific de- 
ficiencies in results, even though the reasons for these deficien- 
cies could not be determined from the test results alone. 

We have already noted that the subject matter basis of 
present achievement tests is restricted perforce to that which 
has been authoritatively described in specific form for the pur- 
poses of instruction, which is largely equivalent to saying that 
it is restricted to the content of recognized, authoritative text- 
books and established courses of study. From one point of 
view at least, this may be considered as a fortunate situation— 
a point of view which merits some consideration in the present 
discussion. 


There are two conflicting considerations involved in the 
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selection of the content basis for achievement test construc- 
tion. In the first place, it is desirable that such tests avoid the 
appearance of encouraging the continuance of the status quo 
in curriculum content, thereby seemingly constituting a hin- 
drance to progress and improvement in curriculum building. 
From this point of view, it would appear that tests intended 
for wide-spread use should be based upon the most advanced 
and approved content available. In the second place, it is de- 
sirable that such tests provide as accurate measures as possible 
of the extent to which the pupil has achieved what he has been 
encouraged and given a reasonable opportunity to achieve. 
From this point of view, it seems that standardized achieve- 
ment tests should be based upon what is now being taught and 
learned. A compromise between these two conclusions is of 
course desirable, but it is important that both viewpoints be 
given adequate consideration in arriving at that compromise. 
Let us first consider the latter of the two points of view. 

We may note first that there is some tendency at present to 
attempt to evaluate the effectiveness of instruction by indi- 
vidual teachers on the basis of the performance of their pupils 
on standardized achievement tests. It is hardly to be hoped 
that the typical social science teacher in high school or junior 
college can prepare the specific instructional materials needed; 
neither can he be held responsible for the determination of 
immediate objectives solely on the basis of the generalized 
and vague descriptions of ultimate objectives which are now 
available. The description and definition of immediate objec- 
tives and the selection, organization and preparation of the 
specific materials of instruction must be made the responsi- 
bility of more highly trained and more competent thinkers, 
namely, the recognized subject matter expert and the cur- 
riculum maker. At the most, all that reasonably can be ex- 
pected of typical classroom teachers, in light of the training, 
experience, ability and teaching loads that such teachers now 
have, is a sufficient appreciation of ultimate and immediate 
objectives to make intelligent and effective use of the instruc- 
tional materials provided them. In the consideration of prob- 





— = 


‘2 








ACHIEVEMENT TESTS IN THE SOCIAL StupIES 207 


lems of this character it is highly important that we avoid the 
common mistake of thinking in terms of what is desirable or 
appropriate for the one superior teacher of our acquaintance, 
rather than in terms of the 99 or 999 teachers who are pos- 
sessed of only average ability and are inadequately trained for 
the work that they are doing. Consequently it is highly ques- 
tionable that the individual classroom teacher should be held 
responsible for not presenting a content and organization for 
which exact instructional materials have not been provided. 
(The failure of the school authorities to provide such mate- 
rials is in many situations very probably due to the failure of 
curriculum experts to prepare them.) Yet this is exactly what 
would happen if standardized achievement tests were based 
upon a content and organization which differed significantly 
from those found in current textbooks and courses of study. 
Furthermore, it should be apparent that the individual pupil 
may be treated unfairly if tests of this character are used to 
provide measures of his general achievement (as well as if 
diagnostic tests are not used for the evaluation and improve- 
ment of instruction). Standardized achievement tests are 
widely used as a basis for determining school marks. As such 
they should measure how well the pupil has learned that which 
he has been asked and encouraged to learn, rather than how 
well he has learned something which he may not even have 
had an opportunity to study. Such tests are also used to 
measure the pupil’s capacity for learning—to discover how 
well he can learn (by measuring how well he has learned) ; 
they are used to measure growth in intellectual achievement 
(by measuring what the pupil has achieved from time to 
time); they are used to measure capacity for growth (by 
measuring past growth) ; and they are used to measure special 
aptitudes for various types of intellectual achievement (by 
measuring past achievements of the same types). If a pupil 
has achieved well that which he has been asked to achieve, 
then certainly he has accomplished something and has given 
evidence of growth, and thereby has demonstrated his ability 
to learn, a capacity for further growth, or an aptitude for 
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achievement of the type measured. He will give evidence of 
these things, furthermore, even though that which he has 
actually achieved does not conform exactly to that which it 
might have been more desirable for him to achieve. Again it 
is highly questionable whether the individual pupil in any sense 
should be blamed for the failure of his school to teach the 
“proper” subject matter, or for the failure of the curriculum 
makers to prepare the “proper’’ instructional materials for 
use in his school. Yet the pupil would be penalized for these 
things if the standardized tests used showed a wide discrep- 
ancy in content from that of current instruction. 

From the viewpoint of the teacher and the pupil, therefore, 
it would appear desirable to construct standardized general 
achievement tests so that they are as purely as possible mea- 
sures of the success with which pupils have learned that which 
they have been encouraged and given a reasonable opportunity 
to learn, and so that they are as little as possible measures of 
the conformity of local courses of study to the latest sugges- 
tions for curriculum revision and improvement. While this 
condition could be approached by making the content basis of 
the test that of the typical local course of study, or by limiting 
it to that content which is common to the various local courses 
of study, such practice might appear to encourage or to sanc- 
tion a static condition in the curriculum. There is, however, 
a better alternative. That alternative is to base the test on 
that subject matter which is common to the best of the text- 
books and courses of study now in use, and to place the major 
emphasis in the test on reasoned understanding of that con- 
tent, rather than upon the factual content itself. On tests of 
such character as that described later in this article, differences 
in test performance from school to school are due primarily to 
differences in the quality or effectiveness of instruction, rather 
than to content differences. On such tests certain schools will 
rank high and others low, not because they are teaching dif- 
ferent materials, but because in some schools the materials are 
being made meaningful and useful to the pupils, while in other 
schools the same materials are being learned by rote, or are 
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only partly learned and understood. Again it should be noted, 
however, that diagnostic tests for determining specific instruc- 
tional deficiencies are of equal importance with the general 
achievement test, and that both types should be used in an ade- 
quate testing program. 

Standardized achievement tests, then, may keep in reason- 
ably close touch with progress in curriculum construction by 
using only the content common to the best of the textbooks 
and courses of study now being used, and may thus keep 
slightly in advance of typical practice. They must also give 
the superior pupil some opportunity to show what he has 
learned beyond the basic requirements of instruction. ‘They 
must not, however, depart too far from current practice, in 
order that they may not become too largely measures of the 
“adequacy” of local courses of study or of their conformity 
to the latest notions of curriculum theorists. 

The road to improvement in the curriculum is not through 
the standardized test. Any real improvements in the cur- 
riculum must come from within. The standardized test should 
not be looked upon as an instrument to compel curriculum re- 
vision, or as a device which will of itself “lift”? the content of 
actual instruction to new and higher levels. It may stimulate 
teachers and pupils, respectively, to teach and learn more 
effectively and meaningfully that which is being taught, but it 
cannot and should not be used to compel teachers to do what 
they are not competent to do, i.e., prepare new subject matter. 

To summarize, then, we have noted up to this point that the 
“field of subject matter” in which pupil achievement may be 
meaningfully measured by a general achievement test is of 
necessity largely restricted to that subject matter which is com- 
mon to the best of current textbooks and courses of study. 
We have noted also that, in view of the uses to which stand- 
ardized achievement examinations are put, this restriction may 
be considered desirable as well as necessary. 

The Double Aspect of Validity—It should be noted that 
the restrictions considered in the preceding section are those 
which apply only to the field of subject matter in which gen- 
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eral achievement may be measured by a single score test. 
There is still a further and equally important restriction, how- 
ever, which applies to the elements of that field of subject mat- 
ter which may be used in a test to measure general achieve- 
ment in the whole field. In other words, while a test may be 
intended to measure general achievement in a defined field of 
subject matter, there are certain elements of that subject mat- 
ter which may not be used in the test itself. 

It is a common misconception that if a test item actually 
(not just apparently) holds the pupil responsible for an item 
of information, skill, ability, understanding or insight, or for 
any other trait which unquestionably belongs to and has an 
important place in the subject tested, and that if it further- 
more is neither so difficult that all pupils tested fail nor so easy 
that all succeed, this item is for these reasons necessarily valid 
for inclusion in a general achievement test. In other words, 
it is often wrongly believed that a test item may be evaluated 
solely on the basis of its difficulty and of the desirability of its 
content for inclusion in the course of study. This misconcep- 
tion has led to much unfair criticism and false evaluation of 
general achievement tests. No comprehensive discussion of 
achievement testing in the social studies would be complete, 
therefore, without some consideration of the specific nature of 
the validity of an item for general achievement testing 
purposes. 

Any single achievement test obviously cannot hold the pupil 
directly responsible for an understanding of or for the ability 
to use, or even for a verbal learning of, all of the specific in- 
formation, relationships, ideas, generalizations, etc., which 
constitute a given field of subject matter. The subject matter 
of United States history, e.g., consists of thousands of items 
of information, and thousands of related ideas, generaliza- 
tions, inferences, implications, etc., based on that information, 
which it might be considered desirable for the pupil to learn 
and understand. If each of these elements could be given a 
weight proportional to its importance or value, then the 
pupil’s total achievement or “general achievement” would be 
measured by the weighted sum of such elements that he has 
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learned and understood. This concept of a true measure of 
general achievement, of course, can be only hypothetical. No 
single test can be constructed and administered which will 
measure each of these many elements directly and individually 
in separate test items. 

The items constituting any given general achievement test 
must be considered as representing only a very restricted 
sampling selected from all of the items that might be con- 
structed on the basis of the subject matter involved. Few 
schools will use a general achievement test that requires more 
than two hours for its administration, and tests of even 
shorter length are most in demand. Such tests cannot well 
include more than 100 to 200 items. With so restricted a 
sampling, it is highly important that each element in this 
sampling, or each item in the test, contribute as much as pos- 
sible to the validity of the whole test. The validity of the 
whole test depends upon the degree to which it ranks pupils 
in the order of their true total achievement. It clearly follows 
that the validity of any single item in the test also must de- 
pend (within limits) upon the degree to which that item of 
itself discriminates between pupils of inferior and superior 
total achievement. If the ability of the pupils to respond cor- 
rectly to a given item shows no relationship to their general 
achievement—i.e., if the pupils who succeed on the item are 
not superior in general achievement to those who fail on the 
item—then that item cannot contribute to the central purpose 
of a general achievement test and cannot be defended for in- 
clusion in the test, regardless of the “validity” of the item for 
inclusion in the course of study and regardless of its difficulty.’ 

It often happens that two objective test items may prove 





* The term “difficulty” as used here refers simply to the per cent of incorrect 
responses in a sample of pupils selected at random from those for whom the 
test is intended, and does not mean intrinsic difficulty of learning. There is 
not necessarily any high relationship between “difficulty” in this sense and in- 
trinsic difficulty. For example, a skill that is intrinsically difficult may never- 
theless be mastered by a large proportion of pupils by dint of hard effort, while 
another skill that could be mastered easily may be acquired by only a small 
proportion of pupils because the need for its acquisition is not apparent or 
emphasized. It should be noted also that in tests of the objective or recognition 
type a significant proportion of the pupils in a given group may select the 
correct response to the item by random guessing, even though none of them had 
really learned or understood the point tested. 
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equally “‘difficult’”” and may hold the pupils responsible for 
equally valid content from the curriculum viewpoint, and yet 
the actual responses made to one may be much more highly re- 
lated to general achievement than those made to the other. 
Certain items, apart from their difficulty or desirability, repre- 
sent far more crucial tests or indicators of general achievement 
than others. For example, in the field of elementary school 
spelling, it has been shown that the ability to spell the word 
“adequately” is very highly related to general spelling ability, 
while the word “advisers” is misspelled more frequently by 
superior than by inferior spellers; yet both words are mis- 
spelled by the same proportion of pupils in a random sample 
of eighth graders, and both words may appear equally desir- 
able for inclusion in the course of study in spelling. 

The worth or effectiveness of a test item depends, therefore, 
not only upon its desirability for inclusion in the curriculum 
and upon its ‘‘difficulty,” but also upon its power to discrimin- 
ate between pupils of high and low levels of general achieve- 
ment. It is important that we recognize this double aspect of 
the validity of a test item, and that we see clearly the relation 
between ‘“‘validity” from the curriculum viewpoint and “‘valid- 
ity’ for achievement testing purposes as determined by the dis- 
criminating power of anitem. The nature of this relationship 
and its various implications are discussed briefly in the follow- 
ing section. 

Before proceeding, however, it may be well to remind the 
reader that we are here concerned only with recognition types 
of items in objective general achievement tests intended for 
wide-spread use. The considerations here presented should 
not be taken to apply to items used in a diagnostic test in which 
the total score is of no significance. They are important in 
general achievement testing only because of the restricted 
sampling employed, and would be of little significance even in 
general achievement testing if a sufficiently broad sampling 
could be taken to insure high validity without these pre- 
cautions. 


The Discriminating Power of a Single Test Item—The dis- 
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criminating power of a single test item refers to the degree to 
which success or failure on that item by itself indicates posses- 
sion of the ability which is being measured. In relation to tests 
of the general achievement type, it may be defined as the ac- 
curacy with which a pupil can be placed along the general 
achievement scale on the basis of success or failure on the given 
item. An item may be said to be perfect in discriminating 
power when every pupil who responds correctly to the item 
ranks higher on the general achievement scale than any pupil 
who fails on the item. An item may be said to have zero dis- 
criminating power when there is no systematic difference be- 
tween the general achievement of the pupils who succeed on 
the item and those who fail. 

Otherwise stated, an item is said to discriminate if the pupils 
who respond correctly to that item are on the average superior 
in general achievement to those who respond incorrectly. If 
the pupils who succeed on a given item are on the average just 
equal in general achievement to those who fail, then the item 
has no discriminating power. The degree of discriminating 
power of an item therefore depends upon the magnitude of the 
difference between the averages in general achievement of 
those who succeed and those who fail on the item. 

Various hypothetical degrees of discriminating power for a 
test item of 50 per cent difficulty are represented in Figure 1. 
This figure shows the various types of relationships which may 
be found between general achievement, as measured by a com- 
prehensive criterion test, and the ability to respond correctly 
to a single given item (in this case an item answered correctly 
by 50 per cent of the pupils in an experimental group). The 
vertical scale in this figure indicates the per cent of pupils who 
responded correctly to the item. The placement of pupils 
‘along the (horizontal) general achievement scale is deter- 
mined on the basis of their percentile standing on the criterion 
test. The “line of discrimination” for a given item indicates 
the percentage of pupils at each level of general achievement 
who responded correctly to the item. 

Line MM represents the line of discrimination for an item 
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Fic. 1.—Hypothetical Lines of Discrimination Showing Stages Between Per- 
fect and Minus Discriminating Power for Items of Fifty Per Cent Difficulty. 


(of 50 per cent difficulty) which shows perfect discriminating 
power, since every pupil below the 50th percentile of general 
achievement missed the item, and every pupil above the 50th 
percentile succeeded on it. The pupil who responds correctly 
to this item may then be accurately placed on the general 
achievement scale with reference to one point, in this case the 
point of median achievement. Only a dichotomous classifica- 
tion, of course, is possible—the pupil’s distance above or 
below the median point in general achievement can not be de- 
termined on the basis of this item alone. 

Line UU represents the line of discrimination for an item 
(of 50 per cent difficulty) which has zero discriminating 
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power, since the same per cent of pupils at every achievement 
level responded correctly to the item. When a pupil responds 
correctly to an item of this type, there is no greater reason for 
placing him on the lower part of the general achievement scale 
than the upper; i.e., he is no more likely to be good than poor 
in general achievement. Items of this type have no functional 
value in a general achievement test, regardless of their other 
characteristics. 

Line VV represents the line of discrimination for an item 
(of 50 per cent difficulty) which has negative discriminating 
power, since it is answered correctly more frequently by pupils 
of inferior general achievement than by pupils of superior 
achievement. A pupil who responds correctly to an item of 
this type is more likely to be Jow in general achievement than 
one who responds incorrectly. Such items can have no func- 
tional value in a general achievement test, unless the pupils 
are “‘given credit” for making the wrong response, which ob- 
viously is impracticable. A large number of items of this type 
has been discovered by the authors in their experimental try- 
outs of test materials in the social studies, and concrete illus- 
trations of them will be presented later. 

Between the extremes of perfect positive and negative dis- 
criminating power all degrees of discrimination may be found. 
These are illustrated (for items of 50 per cent difficulty only) 
in Figure 1 by lines NN, OO, PP, QQ, ete. 

It is very important to note that there is no apparent reason 
for assuming any relationship between the discriminating 
power of a test item and its “difficulty,” or percentage of in- 
correct responses. For example, while only 10 out of 100 
pupils may succeed on a given test item, it may happen that 
these 10 pupils are on the average no higher in general achieve- 
ment than the 90 who fail on the item in question. Similarly, 
an item may be answered correctly by 80 out of 100 pupils 
(i.e., it may be an “easy” item), and yet among the 20 pupils 
who failed on this specific item there may be many who are 
superior in general achievement to some of those who suc- 
ceeded on it. The difference in average achievement between 








216 THE EDUCATIONAL RECORD 


N? Nr ner 


3 


© 
oO 


vu 


Per cent of correct responses 
s $ § 8 8 3d 8 
3 


6 
Ef 


ee 
0.10 20 3% 40 S80 606 0 & 90 100 
Percentile standing on criterion score 


Fic. 2.—Hypothetical Lines of Discrimination Illustrating How Items of Va- 
rious Difficulties May Be Either High or Low in Discriminating Power. 


those pupils who fail and those who succeed may be much 
greater for one item than for another of the same difficulty, 
or for a given ‘“‘easy”’ item than for another that is very difh- 
cult. An item of any difficulty may have any degree of dis- 
criminating power. 

In Figure 2, hypothetical lines of discrimination are illus- 
trated for good and poor items at each of three levels of 
difficulty. 

Line N’N’ represents an item of 80 per cent correct re- 
sponses (20 per cent difficulty) with very high discriminating 
power, and line V’V’ represents an item of the same difficulty 
but with very low discriminating power. The lines N”N” and 
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V’V" represent items of 50 per cent difficulty with high and 
low discriminating power respectively. Lines N’N’, N”N”, 
and N”’N”’ represent items of marked differences in diffi- 
culty, but with the same degrees of discriminating power. Pu- 
pils may not always be assumed to be high in general achieve- 
ment simply because they succeed on a “‘difficult” item, or low 
in achievement simply because they fail on an “easy” item. 
There are many “difficult” items which are more frequently 
answered correctly by inferior than by superior pupils, and 
many “‘easy’’ items which are more frequently missed by good 
than by poor pupils. 

In terms of this illustration, it should be apparent that the 
ideal test would consist of items of high discriminating power 
distributed evenly over the difficulty scale. In other words, 
the ideal test would contain some easy items that discriminated 
sharply at low levels of achievement, others of medium difh- 
culty that discriminated sharply at intermediate levels, and 
still other difficult items that discriminated sharply at high 
levels of achievement. The significance of this ideal distribu- 
tion of item difficulty will be discussed later. 

Statistical techniques have been developed for expressing 
the discriminating power of a test item in terms of a single 
numerical index, or ‘‘index of discrimination.” Because of the 
technicalities involved, no attempt will be made here to de- 
scribe the specific nature of these indices. Jn the later discus- 
sion, however, the numerical values of one of these indices of 
discrimination will be quoted for illustrative test items. It will 
be sufficient for present purposes to explain that the index used 
is such that its value is unity (1.00) for items of perfect dis- 
criminating power, zero (0.00) for items of no discriminating 
power, and negative for items of minus discriminating power, 
and that its value is very highly related to the true discrimin- 
ating power of the item. 

Factors Influencing Discriminating Power.—It has already 
been stated that a test item whose content is highly desirable 
for inclusion in the course of study will not necessarily prove 
to be high in discriminating power. The reasons for this lack 
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of correspondence are many, but they may conveniently be 
classified as: (1) technical weaknesses in the structure of the 
item, as, e.g., ambiguities, irrelevant clues or cues to the cor- 
rect response, unfairly misleading elements as in ‘“‘catch” ques- 
tions, etc.; (2) insufficient learning; and (3) wrong learning 
and negative transfer from other learning situations. 

To illustrate the first of these reasons for the failure of a 
test item to function, we may note that, because of ambiguity 
in phrasing, an item may be more frequently missed by superior 
than by inferior pupils. Suppose, for instance, that a true- 
false statement is open to two interpretations, and that it is 
true if interpreted according to the obvious meaning (which 
may be that intended by the author of the test) and false if 
interpreted according to the unintentionally included hidden or 
second meaning. The obvious meaning is that to which the 
inferior pupils are most likely to respond, and a large propor- 
tion of them may therefore respond correctly, depending on 
the difficulty of the item. Only the superior pupils, however, 
may be capable of recognizing that the statement may be in- 
terpreted otherwise, and, in the belief that it is the second 
meaning for which the test author is holding them responsible, 
they may mark the statement false. In consequence a large 
proportion of the superior pupils would fail on the item as it 
is scored, even though all of them knew the correct response 
to be the obvious meaning. An item of this kind, then, may 
show a negative index of discrimination, even though the con- 
cept which the author intended to test may be perfectly valid 
in the curriculum sense. In other words, the item may prove 
ineffective because its apparent and intended content did not 
correspond to its actual or functioning content. 

Technical defects in item structure which escape the notice 
of the author of the test are perhaps the principal reason why 
many apparently good items fail to function. Extended con- 
sideration will be given to such defects, and to the ways of 
avoiding them, in a later section of this article. For present 

purposes, it is sufficient to note that all defects of this nature 
' are avoidable and can be eliminated if sufficient care is taken 
in test construction and if adequate opportunity for prelimin- 
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ary “try-out’’ of the items is provided. Consequently they 
have little direct bearing on the essential relationship between 
validity from the curriculum viewpoint and validity for test 
purposes, and need not be considered further at this point. 

The Effect of Insufficient Learning or Understanding.—The 
failure of an item to function because of insufficient or wrong 
learning, however, is something beyond the control of the test 
constructor and may necessitate the elimination of certain 
items even though they are perfectly acceptable from the cur- 
riculum viewpoint and are free from technical imperfections. 

Items that fail to function because of insufficient learning or 
understanding are particularly likely to be found in tests of the 
recognition type, such as multiple-choice or “‘best-answer”’ tests 
and matching exercises. The multiple-choice exercise consists 
essentially of a direct question followed by a number of alter- 
nate responses to that question, only one of which is correct, or 
one of which is significantly better than any of the others. In 
the construction of items of this type, a deliberate attempt is 
made to make the incorrect responses appear as plausible as 
possible, in order that the pupil who is uninformed or who does 
not have a thorough understanding of the point raised may be 
likely to select an incorrect response rather than to choose the 
correct response by chance or by random “guessing.” Con- 
sider the following illustration: 


27. What was the principal reason for the increase of the English-speak- 
ing population in the American colonies during the eighteenth cen- 


tury? 

(1) Persecution of the Huguenots..................ceeeeeeees ( 6%) 
(2) Strife in England between Parliament and the king....... (23%) 
(3) The large families being reared by the settlers............. (12%) 
(4) Serious religious struggles in England at that time......... (53%) 


(6% of the pupils omitted the item) 


This item was included in a test administered to more than 
eight thousand United States history pupils in lowa high 
schools. The numbers in parentheses indicate the percentage 
of all pupils selecting each response. 

This item is more than a test of the pupil’s knowledge that 
large families were being reared by the American colonists dur- 
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ing the period indicated, and of his appreciation of the signifi- 
cance of this fact for the increase of population. Given other 
information, the pupil should be able to arrive at this correct 
response by elimination, even though he had not previously 
learned the correct response. For example, aside from the 
question raised, the pupil should know that during the eight- 
eenth century England was quite free from serious struggles 
of a religious character. Enough English history is taught in 
United States history textbooks to provide him with this infor- 
mation. The fact that 53% of the pupils selected response 4 
is some indication that the pupils were not well acquainted 
with happenings in the mother country during the eightenth 
century. The fact that 53% of them selcted this response is, 
furthermore, evidence that the selection was deliberate in most 
cases, since random “‘guessing’’ could never have accounted for 
so large a proportion. Similarly, the well-informed pupil 
should have been able to eliminate responses 1 and 2 on the 
basis of the knowledge that serious political differences be- 
tween Parliament and the king had been settled before the be- 
ginning of the eighteenth century, and that the Huguenots 
were not being persecuted in England during that period and 
had not been persecuted there at any other time. An analysis 
of the responses to this item indicates that most of the pupils 
did not know with any certainty that response 3 was correct, 
and the item therefore became largely a test of the pupil’s un- 
derstanding of the related information required for the elim- 
ination of the incorrect responses. 

An item of the multiple-choice type then represents more 
than merely a test of the pupil’s knowledge of the single point 
raised by the question or of his ability to recall a memorized 
“pat” answer to that question. It is also, and often to a sig- 
nificant degree, a test of his ability to relate other information 
to that directly called for, and of his ability to discriminate 
among several alternatives on the basis of such related infor- 
mation. It tests for knowledge of what is not correct, as well 
as for knowledge of what is correct. It tests the certainty and 
the meaningfulness of the pupil’s knowledge, rather than 
merely his verbal memory of a fact which may have been 
learned by rote. A single multiple-choice test item may there- 
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fore hold the pupil responsible simultaneously for a number of 
related facts or understandings rather than for only one. 
These characteristics may appear to be desirable, and in 
most cases are desirable, in an item to be used in a general 
achievement test, but they also may often lead to a complete 
failure of the item to function properly. The superior pupils 
in the group tested may have just enough information and un- 
derstanding to arrive at a certain inadequate or wrong but 
highly plausible solution to a given problem, but not quite 
enough information and understanding to be able to select the 
correct response. An analysis of the responses to the illustra- 
tion just given showed that the pupils who selected the correct 
response were, on the average, inferior in general achievement 
to those who selected incorrect responses (as measured by 
their average scores on a relatively comprehensive examin- 
ation over the whole field) ; i.e., the item showed a negative 
index of discrimination. Apparently the superior pupils knew 
that political and religious strife in England had at some time 
been an important cause of migration to the colonies, but did 
not know that during the eighteenth century England was free 
from serious struggles of this nature. This is a case, then, 
where “‘a little knowledge is a dangerous thing.” What the 
better pupils did know predisposed them to select responses 2 
and 4, whereas the inferior pupils, who did not know even that 
much, probably resorted to “‘guessing” and by chance hit upon 
the correct response more frequently than did their more able 
classmates. Whether or not this explanation is correct in 
detail, the fact remains that the item did show a negative index 
of discrimination, and that it therefore did detract from the 
central purpose of the complete examination—which was 
to discriminate between pupils at various levels of general 


achievement. In other situations it would, of course, be val- 
_ uable to know that the pupils in a given group are not capable 


of making the discrimination called for in this item, but the 
item does not have a place in a general achievement test in- 
tended for high school pupils. 

The same point may again be illustrated by another item ad- 
ministered to the same group of pupils, in this case an item 
with a negative index of discrimination of —.17. 
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8. What was one of the important immediate results of the War of 1812? 


(1) The introduction of a period of intense sectionalism......... (39%) 
(2) The destruction of the United States Bank................. ( 7%) 
(3) The defeat of the Jeffersonian Party.............0cceeeees ( 7%) 
(4) The final collapse of the Federalist Party.................. (43%) 


(4% omitted the item) 


The correct response to this item is number 4. Neverthe- 
less, the pupils who selected the first and incorrect response 
were, on the average, superior in general achievement to those 
who selected the correct response (number 4). Again, the 
pupils selecting the first and incorrect response apparently did 
so because of positive but insufficient learning. They knew 
that a period of intense sectionalism did set in before the 
middle of the century, and therefore chose the first response. 
Apparently they did not know, or failed to recall, that a short 
period of intense nationalism was an immediate result of the 
Second War with Great Britain, and that this war therefore 
could not be considered as “introducing” an era of sectional 
strife. Other pupils, with less knowledge in general, were able 
to select the correct response since they were not attracted to 
the first response by a certain knowledge that intense section- 
alism did develop in the nineteenth century. (It should be 
noted, however, that for an abler group of pupils, capable of 
making the judgment called for, this same item might have 
shown a high positive index of discrimination. ) 

Items of the recognition or multiple-choice type, then, pre- 
sent certain unique problems as compared to items of the recall 
or essay type. In the essay examination or in the recall type of 
test an item that is beyond the ability of all pupils tested would 
simply fail to function at all. Every pupil tested would miss 
or omit the item, and its presence in the test would have no in- 
fluence upon the relative magnitude of the scores earned. It 
might therefore do no positive harm in the test, but even so, 
of course, it might better be replaced by an item that does func- 
tion. In a multiple-choice exercise, however, some of the in- 
ferior pupils might select the correct response by chance or be- 
cause their rote learning is impervious to the plausibility of the 
alternate responses, while the superior pupils may consistently 
select a certain incorrect response which appears plausible in 
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light of their superior but still insufficient knowledge or under- 
standing. In that case the item will show a negative index of 
discrimination and will thus detract directly from the validity 
of the entire test. 

In the construction of recognition types of items in objective 
tests it is therefore particularly important that the judgments 
called for are not beyond the ability of the superior pupils in 
the group to be tested. Items of this kind may prove perfectly 
valid for discriminating between pupils at a higher level of 
achievement, but if there are no pupils at that level in the 
group to be tested, then the item can not be defended for in- 
clusion in a test intended for such a group. The level of 
achievement for which test items can hold the pupils respon- 
sible must not exceed that which has actually been reached by a 
significant proportion of the pupils in the group for which the 
test is intended. If adequate recognition were given to this 
fact, there perhaps would be less demand for the inclusion of 
“reasoning items’”’ of a high order in general achievement 
tests. In certain cases, items of this type not only may add 
nothing to the test but may even interfere with its usefulness. 

The Effect of Wrong Learning.—Wrong learning (as well 
as insufficient learning) on the part of the pupils for whom the 
test is intended may cause an item in that test to show a neg- 
ative index of discrimination. For example, the following 
item showed a negative index of discrimination of —.34 for a 
random sample of 1,000 pupils selected from more than 8,000 
pupils in United States history in lowa high schools. The per 
cent of all pupils that selected each response to this multiple- 


choice item is indicated by the numbers in parentheses to the 
right of the response. 


15. In the second half of the fifteenth century the Portuguese were search- 
ing for an all-water route to India because— 


(1) They wished to rediscover the route travelled by Marco 


eb 0 060.0460 eusnebds gene ende opaeessautseusbetsweanedh ( 4%) 
(2) The Turks had closed the old routes...................46. (59%) 
(3) The Spanish had proved that it was possible to reach the 

ee eT ee Te eee (10%) 
(4) An all-water route would make possible greater profits... .. (26%) 


(1% omitted the item) 
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It will be noted that more than half of the pupils selected 
response number 2. The negative index of discrimination in- 
dicates furthermore that the average achievement of the pu- 
pils who selected this response was superior to that of the 26 
per cent of the pupils who chose the correct response, number 
4. Inthe light of Lybeyer’s research, the explanation given in 
response number 2 is certainly inadequate, if not outright fal- 
lacious. Authoritative historians no longer would accept the 
second response as a sufficient explanation of Portuguese at- 
tempts to round Africa, nor would they deny that response 
number 4 is the best of those given. An analysis of current 
textbooks in American history, however, will reveal that these 
lag behind research and that many of them still present the 
now disproved explanation: ‘“‘The Turks closed the old 
routes.”’ It is not surprising, therefore, that the superior pu- 
pils are more likely to select this response than those who have 
made little or no effective attempt to learn the facts contained 
in their textbooks. This being the case, the inclusion of this 
item in the test not only contributed nothing to its effective- 
ness but even detracted from it. There can be little question, 
however, that the item is free from technical imperfections or 
ambiguities, and that it does hold the pupil responsible for an 
established fact of considerable significance in history. 

The following item, also taken from the 1932 Iowa Every- 
Pupil Test in United States History, similarly showed a neg- 
ative index of discrimination, in this case of —.13. 


30. America’s entry into the World War was largely caused by the 
(1) Fear that the defeat of the Allies would lead to the over- 


throw of republican government in France................ (16%) 
(2) Violation of Belgian neutrality.....................0000: (45%) 
(3) Fear of losses by the moneyed interests if the Allies were 

IG i 6:05 66H bia res secretin sth sie Weds cb (30%) 
ae ES kD | ( 5%) 


(4% omitted the item) 


While this item deals with a controversial interpretation, 
and while there consequently may be some disagreement about 
which constitutes the best response, it nevertheless provides an 
excellent illustration of what may happen when the pupil is 
held responsible for a controversial opinion. Pupils have been 
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encouraged, both as the result of direct instruction and as the 
result of popular prejudice or unreasoning patriotism, to be- 
lieve that altruistic or idealistic motives underlie important 
national actions or policies. In this case, the 30 per cent se- 
lecting response number 3, which was keyed as correct, were 
in general inferior in total achievement to those who selected 
the other responses. This is only to be expected, since the 
better the pupil learns what he has been taught and encour- 
aged to believe, and the more widely he reads “popular”’ his- 
tory with a nationalistic tinge, the more likely he is to search 
for altruistic motives in an item of this type. While response 
number 3 undoubtedly would be accepted by many historians 
as an underlying motive for America’s participation in the 
World War, certainly it is not widely taught in our schools at 
present. 

It is not uncommon for the pupils in our public schools, be- 
cause of biased teaching and unreasoning prejudices, to ascribe 
flattering motives for certain national actions or policies in 
cases where historians will agree that the real and fundamen- 
tal motives were undoubtedly of a different character. Items 
based on these situations, and keyed to correspond to the 
opinion of authoritative historians rather than to popular 
opinion, will frequently show negative indices of discrimina- 
tion. Items dealing, e.g., with issues such as the justification 
and responsibility for the Mexican and the Spanish-American 
Wars, or with the moral aspects of actions prompted by im- 
perialistic ambitions, such as the annexation of Texas and the 
“purchase” of the Philippines, or with the “‘right’’ of the Con- 
federate states to secede, will almost invariably constitute 
poor test materials if keyed to agree with the interpretations 
of eminent present-day historians. To include items of this 
kind would frequently only lower the validity of the test for 
the purpose of measuring general achievement. They must 
therefore often be eliminated from general achievement tests, 
even though they would be of distinct value in diagnostic 
testing. 

Homogeneity of Subject Matter in Relation to Achieve- 
ment Testing.—This approach to the problem again empha- 
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sizes and establishes more conclusively the fact that if a gen- 
eral achievement test is to yield a highly meaningful single 
score it must deal with a relatively homogeneous field of sub- 
ject matter or with one in which learning has been reasonably 
consistent throughout. Fortunately the subject matter of his- 
tory contains only a comparatively small proportion of mate- 
rial which is being wrongly learned, if learned at all, and it is 
therefore possible to construct tests that yield meaningful 
single scores as measures of total achievement in the whole 
field. Such materials as are being wrongly learned at present 
by pupils at a given school level, providing that the wrong 
learning is in general more characteristic of good than of poor 
pupils, must be eliminated from general achievement tests in- 
tended for pupils at that level. If these wrongly learned ma- 
terials are to be tested at all, they must be tested in separate 
examinations. 

It is important to note, however, that where wrong learning 
of this type does take place, it is usually due to imperfections 
in the course of study and to other factors for which the pupil 
himself, and in many cases even the teacher, is not in any sense 
to be blamed. In such cases, the fact that the pupil has 
learned the wrong thing may be as good an index of high gen- 
eral achievement, of conscientious effort, and of superior abil- 
ity to learn, as is the fact that he has learned the right thing in 
other situations. If separate tests are constructed to measure 
outcomes of this sort, these tests may not be included in an 
“achievement” testing program as it is ordinarily conceived. 
Achievement tests are often used as measures of learning abil- 
ity or as the basis for predicting future success. Certainly it 
would not be fair, in measures of this type, to penalize the 
pupil or to refuse him credit because he has learned well the 
very things that he has been asked or encouraged to learn. 

It should again be remembered that these considerations 
apply only to items that are to be used in general achievement 
tests. It of course would be desirable to build tests of other 
types, such as diagnostic tests, through which it would be pos- 
sible to determine what specific things are being wrongly 
learned by the pupils or to discover what is their opinion con- 
cerning controversial issues. Items of this kind, however, 
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cannot safely be included in tests of the general achievement 
type. 

The Range of Difficulty of Test Items.—In the preceding 
discussions the statement was made that the ideal test would 
consist of items evenly distributed over a scale of difficulty cor- 
responding to the range of actual achievement in the group 
for which the test is intended, and that each item in it would 
discriminate sharply at its own level of difficulty—i.e., that it 
would discriminate between pupils above and below the cor- 
responding level of achievement. ‘The implications of this 
statement for the selection of the subject-matter which is to 
serve as the basis for test construction are extremely impor- 
tant. They do not appear, however, to be generally under- 
stood, and are deserving of more detailed consideration than 
was given them in the preceding section. 

The range of achievement over which a test should hold 
pupils responsible must be adjusted to the range of achieve- 
ment actually found in the group for which the test is intended. 
Tests intended for wide-spread use, such as standardized tests, 
must therefore be adapted to the full range of achievement 
found in all schools in which they are to be used. 

The actual magnitude of this range is much greater than 
is ordinarily supposed. In the lowa Every-Pupil Testing Pro- 
gram of 1923, which involved the administration of tests in 
seventeen subjects in 365 high schools, it was found, e.g., that 
the highest score made on the physics test in one high school 
(of over 1,200 pupils) was lower than the lowest score made 
on the same test in another school of the same size. Ninety- 
five per cent of the pupils in one large high school earned a 
higher score on the test in United States history than that 
which was exceeded by only two per cent of the pupils in an- 
other large school. In any one of the seventeen subjects 
tested, it was found that the difference in average scores be- 
tween the highest and lowest ranking schools was no smaller 
than the difference betwen the highest and lowest scores of 
individual pupils in the typical school—i.e., the variability in 
school (average) achievement was almost exactly the same 
for all schools as the variability in pupil achievement in a typi- 
cal school. 
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If a test is to discriminate well at all levels of achievement 
in a range so wide, it must contain some items that appear ex- 
tremely easy to the best schools and others that appear ex- 
tremely difficult to the poorest. Certain items must be such 
that they are quite sure to be answered correctly by the upper 
90 per cent of all pupils in all schools, and must at the same 
time prove too difficult for the lower 10 per cent to respond to 
them correctly. Items of this kind are almost invariably of 
the ‘‘informational” character, since the pupils at lower levels 
of achievement do not go far beyond the acquisition of simple 
information. 

The following item, e.g., was missed by only 5 per cent of 
more than 8,000 United States history pupils in lowa high 
schools. It nevertheless had a relatively high index of dis- 
crimination, and was as essential in the test as many others of 
superior ‘‘quality.”’ 


20. Which of the following are known for their participation in the gold 
rush to California? 


(1) Puritans (4) “Forty-niners” 
(2) Free-soilers (5) “Six Nations” 
(3) Grangers 


This item appears so easy and factual that it might be con- 
demned as “‘puerile” by many critics of the standardized ob- 
jective achievement test, and many similar items have been so 
condemned. The fact remains, however, that 5 per cent of 
the pupils (more than 400 of them in this case) did miss the 
item, and that they were pupils of inferior general achieve- 
ment. As long as pupils are achieving only at this low level, 
achievement tests must include items of this type. 

The following items, again, proved to be unusually high in 
discriminating power, but are likewise of the type frequently 
condemned because of being so easy and so purely factual. 

37. The capitol of the Confederacy was 


(1) Atlanta (4) Havana 
(2) Boston (5) Richmond 
(3) Chicago 
52. The first circumnavigation of the globe was completed during the period— 
(1) 1400-1449 (4) 1550-1599 


(2) 1450-1499 (5) 1600-1649 
(3) 1500-1549 
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These items were answered correctly by 84 per cent and 71 
per cent of 8,000 pupils, and showed indices of discrimination 
of .69 and .75 respectively, which are index values only rarely 
exceeded by test items of any type. 

General achievement tests in the social studies, intended for 
high school pupils, frequently have been criticized because they 
are limited to the testing of information and of a low level of 
understanding. While these criticisms in most cases have 
been well deserved, it should be recognized that it is possible 
for a test to err as badly in the other direction by holding the 
pupil responsible for understanding at too high a level. It 
should be obvious that an achievement test cannot measure 
something which does not exist. If only a negligible propor- 
tion of high school pupils exceed a given level of understand- 
ing or achievement, then there is no point in including items 
that go beyond that level. Agya mater of fact, as has been 
specially illustrated in the preceding paragraphs, the authors 
have found, in the test materials prepared by them for the Co- 
operative Test Service and for the lowa Every-Pupil Testing 
Program, that they already have exceeded this limit in some 
of the items constructed. Among these were items that in ad- 
vance of try-out appeared to be the best, since they did test 
for reasoned understanding of a relatively high order. Upon 
try-out, however, these very items proved to give negative or 
low indices of discrimination for high school pupils. 

There can be no question that the level of understanding 
which, under present instruction, is actually reached in the 
social studies by high school pupils is in general much lower 
than might be wished. The facts for the items just presented 
indicate that it may prove necessary to continue to limit a 
large proportion of the items in high school general achieve- 
ment tests to information and to a low level of understanding, 
although perhaps at a somewhat higher level than has been 
characteristic of most tests that have ben built thus far. 

The problem of constructing items that will discriminate 
properly at the high levels of achievement is of quite another 
nature. The really superior pupils are those who go far be- 
yond the “minimum essentials” or the basic requirements of 
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instruction, and who acquire information and are capable of 
judgments that not only are not expected in the typical pupil 
but are practically certain to be beyond his ability. Items that 
are to discriminate effectively at these higher levels must go 
into the deeper aspects of the subject matter, and must test for 
information or understanding that is quite sure to be beyond 
the achievement of a large per cent of all pupils. The follow- 
ing item, for instance, was answered correctly by only 15 per 
cent of more than 6,000 world history pupils in lowa high 
schools in 1932. (This percentage is very small in consider- 
ation of the fact that many pupils probably selected the cor- 
rect response by thoughtless guessing. ) 


53. The basic purpose of the Soviet system as worked out in Russia is to 
insure— 


(1) A separation of legislative and executive authority. 
(2) Social, political and economic equality for all. 

(3) Popular control of the government. 

(4) A dictatorship of the proletariat. 

This item, again, might be condemned by some critics be- 
cause the information called for is not “taught” directly in 
some of the textbooks now being used. It is taught, however, 
in the better and more recent texts and courses of study, and 
any pupils who read contemporary history in the usual class 
references or in current periodicals, as they are encouraged to 
do, will have had the opportunity to learn the facts needed to 
answer this question. Any adequate achievement test, in- 
tended for wide-spread use, if it is to discriminate effectively 
at high levels of general achievement, must contain items deal- 
ing with information or ideas not found in any list of minimum 
essentials. It is not consistent, therefore, to attempt to check 
test content against such lists or against descriptions of what 
is desirable and possible in the way of achievement for all 
pupils or for the typical pupil. 

It follows then that when properly constructed achievement 
tests are administered in regional testing programs involving 
many schools, these tests will appear very difficult in some 
schools and relatively easy in others. Test research has shown 
that in general a test will best measure the individuals in a 
given group if the average score earned is about 50 per cent 
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of the possible score. The norm on a standardized test in- 
tended for pupils at a given school level should therefore pref- 
erably be about half of the possible score on the test. With 
the wide variability in school achievement which now exists, 
this means that in some schools the average score will be per- 
haps only 15 per cent or less of the possible score, and in 
others it may approach 70 per cent or 80 per cent of the pos- 
sible score. 

Popular conceptions of what is the proper difficulty of an 
achievement test of the objective type have been seriously at 
fault because of an attempt to apply standards which have 
been developed for the traditional essay type of examination. 
On the essay examination, the average “score” or per cent 
grade was usually between 80 per cent and 90 per cent of the 
possible score of 100 per cent. If a large proportion of the 
pupils tested were below 70 per cent or 75 per cent (the “‘pass- 
ing” grade), the test was considered too difficult. Standards 
of this kind clearly do not aply to objective achievement tests, 
and must not be allowed to confuse the real issues. 

Summary of Restrictions upon the Content of a General 
Achievement Test.—In summary, then, the specific content of 
a general achievement test intended for a given group of pu- 
pils is subject to the following definite restrictions : 

1. If we think of the entire group of pupils as separated 
into a number of levels of general achievement, then for each 
of these levels the test must contain an approximately equal 
number of items calling for information that the pupils at 
that level have learned, or for ideas and generalizations that 
they do understand, or for judgments, applications or reason- 
ing of which pupils at that level are capable. 

2. The items thus selected with reference to each level of 
achievement must discriminate as sharply as possible between 
pupils above and below that level; i.e., it must (ideally) be 
highly probable that all pupils above that level will succeed on 
each of those items and that all pupils below that level will fail 
on each of them. (This is particularly important in recogni- 
tion tests with reference to items that call for judgments be- 
yond the ability of the pupils tested. ) 
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3. The items must be such that the response scored as the 
“correct” or “best” response would be considered so by com- 
petent authorities. (If the wrong response of certain items 
could be scored as “‘correct,”’ these items would meet the first 
two requirements. ) 

4. The items must hold the pupil responsible for under- 
standings, abilities or information that it is believed will con- 
tribute to the realization of the objectives of instruction; i.e., 
they must be based upon subject matter which has been author- 
itatively and specifically selected and described for purposes 
of instruction, and which does belong to the field of subject 
matter involved. 

These discussions of the technical aspects of test construc- 
tion have shown that the problem of defining a field of subject 
matter in which general achievement is to be measured, and 
the problem of selecting elements of that subject matter for 
the construction of items in a general achievement test, pre- 
sent very marked and significant differences. The items in a 
test do not by any means represent a random or representative 
sample of the content of the field in question. While every 
attempt should be made to make the sampling as representa- 
tive as possible, certain items must be excluded because of tech- 
nical considerations. What the test may contain is very 
largely a function of what has been learned and of what is the 
level and range of achievement in the group to be tested. The 
content of achievement tests therefore cannot be expected to 
parallel the course of study exactly, and such examinations can 
neither be used to “check” nor be checked by course of study 
outlines directly. The problem of selecting test items cannot 
be left to the subject matter expert or to the subjective judg- 
ment of anyone, but is mainly a technical problem and must be 
based upon objective facts secured from actual trials of large 
numbers of items with pupils of the kind to which the com- 
pleted test is to be administered. 


E. F. Lrypauist, 
H. R. ANDERSON, 
University of Iowa. 
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RELATION OF THE TESTING OF ATTITUDES TO GENERAL 
ACHIEVEMENT TESTING 


One of the major criticisms directed against generai 
achievement tests in the social studies is that they have not 
provided for the measurement of such ultimate objectives in 
instruction as the development of “‘desirable emotionalized at- 
titudes, ideals, and modes of behavior.” The preceding dis- 
cussions have assumed that the direct measurement of such 
ultimate objectives is not the function of the general achieve- 
ment test. The reasons for this limitation will shortly be pre- 
sented. Because of the persistent repetition of this criticism, 
however, it seems desirable first to consider certain important 
issues, involved in the whole field of attitudes testing, which 
must be more satisfactorily met before the measurement of 
attitudes for the evaluation of instruction can be satisfactorily 
performed by any type of test. 

Are Attitudes, Ideals, and Modes of Conduct General or 
Specific?—In the discussions in which achievement tests have 
been criticised for a failure to measure attitudes, ideals, and 
habits of conduct, there have been frequent references to the 
development of such generalized modes of behavior as are 
implied in the terms: “‘open-mindedness,” “sympathy,” “‘coop- 
eration,” “honesty,” “tolerance,” etc. A brief consideration 
will reveal that it is neither possible nor desirable to establish 
a set pattern of behavior based upon generalized attitudes and 
ideals of the type mentioned, and which would or should op- 
erate consistently in all of the wide variety of specific situa- 
tions which the pupil will meet. For example, it may be highly 
desirable that a boy show a “cooperative attitude” or become 
a team-worker as a member of a football team, but highly un- 
desirable that he cooperate with a gang in marauding expedi- 
tions against neighborhood stores. Similarly, one might wish 
the pupil to develop a sympathetic attitude toward the legit- 
imate demands of the victims of technological unemployment, 
but one would hardly wish this attitude to carry over in a situ- 
ation in which some evil-doer blames the depression for his 
embarking on a career of crime. As a further example, it 
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seems desirable that the pupil be open-minded in weighing the 
advantages and disadvantages of the municipal ownership of 
public utilities, but few persons would suggest that “tolerance” 
be carried to the point where the pupil will complacently enter- 
tain suggestions for the substitution of anarchy for organized 
government. 

From the foregoing considerations it follows that these ‘“‘de- 
sirable attributes” in the individual must be thought of as con- 
sisting of specific attitudes, specific ideals, and specific modes 
of behavior with reference to specific situations or types of 
situations. While it may be convenient, for the purposes of 
general discussion, to speak of attitudes, ideals and habits in 
broad generalized terms, any such description cannot consti- 
tute a workable basis for the purposes either of teaching or 
of test construction. Any “generalized” attitude must be con- 
sidered merely as a collection of related specific attitudes 
grouped with reference to a convenient collective term. 

Should Tests of “Generalized” Attitudes, Ideals, and Modes 
of Behavior Recognize Subject Matter Boundaries?—It must 
be apparent that it is not the sole responsibility of the social 
studies to develop all of the specific attitudes, ideals, and 
modes of behavior implied in such general terms as “honesty,” 
“cooperation,” ‘“‘sympathy,” “tolerance,” and the like. The 
specific modes of behavior suggested by the general term “‘co- 
operation,” e.g., are developed in a large number of in- and 
out-of-school situations, the majority of which have no direct 
connection with the social science classroom. For example, in 
the course of a single day the pupil may cooperate with his 
family by eating breakfast on schedule, with school officials 
by not being tardy, with any or all of his teachers by preparing 
his lessons, with his team mates by “blocking” properly in a 
football game, and so on ad infinitum. Similarly, the pupil 
may develop specific ideals or habits of honesty by writing his 
own theme rather than copying that of his friend, by refrain- 
ing from stealing an apple while passing along the counter of 
the school cafeteria, etc. 

Even though it were possible, therefore, to construct a 
meaningful test to measure a number of specific attitudes, 
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ideals, or modes of behavior which have been grouped around 
a general term such as “honesty,” “cooperation,” or “‘sym- 
pathy,” such a test obviously could not recognize subject mat- 
ter boundaries. Consequently it is not reasonable to criticize 
an achievement test in, e.g., United States history for failing 
to measure “generalized” attitudes, ideals and habits which 
have resulted from the sum total of the pupil’s in- and out-of- 
school experiences. 

What Are the Specific Problems and Situations Toward 
Which It Is the Unique Responsibility of the Social Studies to 
Develop Attitudes, and What Is the Desirable Attitude in 
Each Case?—While tests of “‘generalized”’ attitudes, if con- 
structed, cannot recognize subject matter boundaries, it is ad- 
mitted that there are specific attitudes which can better be 
developed with reference to one branch of learning rather than 
another. The social studies are distinctively concerned with 
a number of social institutions, problems and practices toward 
many of which it is quite possible to develop emotionalized 
attitudes on the part of pupils. It is only toward these insti- 
tutions, problems and practices, if toward any, that instruction 
in the social studies can be held distinctively responsible for 
the formation of attitudes. 

In order that he may construct attitudes tests to be used 
for the evaluation of instruction in the social studies, it is 
clearly essential that the test technician be provided with an 
authoritative description of the specific situations or types of 
situations in which attitudes should be developed, and that he 
know what is considered the desirable attitude in each situa- 
tion. It should be noted that the preparation of attitudes tests 
for the evaluation of instruction presents important problems 
not met in the construction of attitudes “‘scales’’ such as are 
now being developed by Thurstone and others. One who is 
interested only in describing the direction and intensity of a 
specific attitude in an individual or group of individuals need 
take no responsibility for the evaluation of the attitude found. 
That is to say, one can determine, e.g., whether or not a given 
individual believes that the church is a desirable social institu- 
tion without having to decide what that individual should be- 
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lieve. Similarly, one can locate a given individual along an 
arbitrary scale ranging from “extremely favorable” to “‘ex- 
tremely unfavorable” with reference to his attitude toward 
socialism without having to decide at which end of the scale 
it is socially desirable that the individual be found and without 
even having to decide whether or not this attitude situation 
is of any significance for instruction. Both of the latter types 
of questions would have to be answered, however, before such 
scales could be used for the evaluation of the results of instruc- 
tion in terms of a “score” (or scores) analogous to those 
secured from general achievement tests. 

At the present time no comprehensive and authoritative de- 
scriptions of the specific situations or types of situations in 
which attitudes should be developed have been made available 
to the test technician. Furthermore, for reasons which will 
now be presented, it seems highly questionable that any such 
statements will be forthcoming in the very near future. 

An emotionalized attitude is an idea, generalization or opin- 
ion in which the individual believes and concerning which his 
convictions have been emotionally intensified. What, then, are 
the generalizations or opinions concerning these institutions, 
practices and problems which the student should be taught to 
believe? The very term “social problem” immediately sug- 
gests a controversial issue. For example, prohibition, the 
entry of the United States into the League of Nations, and 
private ownership of public utilities are representative current 
problems. Who can say, with reference to any of these prob- 
lems, which attitude (favorable or unfavorable) it is socially 
desirable that the pupil develop? Should the pupil be taught 
to favor national prohibition, or to regard it with disfavor? 
Should he be taught to prefer public or private ownership of 
public utilities? Definite answers must be provided for these 
and similar questions before the “desirable” attitude toward 
these and other situations can be either developed in teaching 
or measured in tests intended to yield “scores” upon which 
evaluations may be based. 

Not only is it difficult, in relation to most of the problems 
considered in the social studies, to determine what at present 
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appears to be the socially desirable attitude, but it is even more 
difficult to determine what attitudes are likely to remain so- 
cially desirable for a sufficiently long period of time to justify 
their development. It frequently happens that altered circum- 
stances cause a belief or opinion, once generally accepted, to 
be ruled invalid. For instance, fifteen years ago it was gen- 
erally held in this country that the Central Powers were re- 
sponsible for the outbreak of the World War. Information 
subsequently brought to light has caused most scholars to 
revise this hasty judgment. Today it would be the overwhelm- 
ing verdict of competent authorities that the correct opinion 
concerning war guilt is one favoring divided responsibility. 
Even so, it is quite possible that at a future date the discovery of 
new facts may necessitate further revision of this judgment. 
Again, consider the changing attitude toward legislation in- 
volving unemployment, old age, and accident insurance. Until 
the frontier disappeared about fifty years ago, there was little 
demand for-such relief; today the leading social scientists are 
in substantial agreement that this type of social legislation 
should be enacted. Historians hold that each generation must 
rewrite the history of what has gone before. This, of course, 
is in recognition of the fact that new data and new interpreta- 
tions may upset much of what has been considered established 
truth. What today is taught the pupil as best opinion may be 
revealed, even before he has left school, as mistaken judgment, 
or may have become a dead issue. 

Furthermore, it may be reasoned that the development of 
uniformity in attitudes can result only in a dead level of con- 
formity, which in itself is socially undesirable. In his essay, 
“The Agitator in History,” Cheyney expresses this thought in 
the following words: “There is just one absolutely fatal and 
hopeless condition into which mankind can fall; that is the 
inertia of stability. . . . The agitator is the man who destroys 
this equilibrium, who overcomes this inertia, who disturbs stag- 
nation. He is the one who, striving to bring about some social 
or political advance, enlightens ignorance, stirs indifference, 
arouses courage, or in other ways lifts men from the dead 
level of willing acceptance of bad existing conditions.” In 
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the opinion of Cheyney, the agitator plays an important role 
in the march of civilization exactly because he does not con- 
form to the social pattern which the weight of public opinion 
holds to be respectable and proper. 

Many authorities maintain that there is considerable danger 
in setting up as ultimate objectives of instruction the develop- 
ment of emotionalized attitudes toward current social prob- 
lems. The point of view that the real function of instruction 
in the social studies is to offer the pupil a rationalized basis for 
forming tentative conclusions and that the development of set 
attitudes on an emotionalized basis should be avoided has re- 
ceived much serious consideration. In view of the fact that 
the great characteristic of history is change, it has been rea- 
soned that the function of history instruction should be to pro- 
vide the student with that related information and with those 
relatively fixed and established concepts and generalizations 
which are pertinent to the solution of current problems, but 
that the general attitude, if any, which he should develop 
should be that of reserving any final judgment—of standing 
ready at any time to accept and to integrate new information 
and new ideas which may require revision of his tentative con- 
clusion. With reference to many of the crucial problems of 
the present day, it probably is desirable that the pupil grow 
into adulthood without developing any final set attitudes. 

There are many difficulties, then, in the way of the prepara- 
tion of a comprehensive and specific description of the situa- 
tions in which instruction in the social studies should develop 
attitudes. It is not likely that any such description will be 
prepared and generally accepted in the very near future. 
Until this description is made available, however, the test tech- 
nician will be in no position to select and combine specific atti- 
tudes into a measuring instrument that may be used for the 
evaluation of instruction. Finally, it is not the responsibility 
of the test technician to decide what attitudes should be de- 
veloped, nor is it therefore his responsibility to decide what 
attitudes should be measured in an evaluation type of test. 

The Significance of the “Single Score’ Feature in Relation 
to the Testing of Attitudes—The preceding discussion has 
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limited the subject matter basis of general achievement tests 
to purely rationalized experiences, to the exclusion of emo- 
tionalized attitudes, ideals, etc. While this delimitation has 
been defended on other grounds, the final and more conclusive 
reason for it lies in a consideration of the single score feature 
of a general achievement test. A single score as a composite 
measure of a collection of specific achievements is meaningful 
only to the degree that these specific achievements are homoge- 
neous and inter-related, and loses meaning in proportion to 
their heterogeneity. Highly diversified characteristics must 
be measured separately. For example, one would not attempt 
to express in terms of a single numerical measure a composite 
of the weight, color and utility of a piece of furniture. Such 
a measure would be meaningless, not only because these fea- 
tures are so diverse in character, but also because measures of 
them would show no definite relationship for furniture in gen- 
eral. It is almost equally futile to attempt to describe mean- 
ingfully, in terms of a single score, a pupil’s general attitude 
toward all of the various social, economic, political and civic 
institutions and problems which are considered in the social 
studies. Suppose it were possible, e.g., to describe in terms 
of position along an arbitrary scale a pupil’s attitude toward 
private ownership of public utilities, and, in spite of the diffi- 
culties already indicated, to designate one end of the scale 
rather than another as that on which the pupil should be 
located, and also that it were possible to describe similarly his 
attitude toward disarmament. Any attempt to combine these 
two descriptions into a single score obviously would result in a 
measure far less meaningful than the two descriptions consid- 
ered separately, and perhaps even in a measure completely 
lacking in significance. 

Attitudes toward social, civic, political and economic prob- 
lems, therefore, can not be combined into a single test and 
described meaningful in terms of a single score, simply because 
they are so diverse in character and show such low inter-corre- 
lations. It is extremely questionable, furthermore, that they 
should show high inter-correlations for pupils in general, even 
though instruction could achieve this end. While there are 








240 THe EpuUCATIONAL RECORD 


many attitudes which, in the interests of reasonable stability 
of society, the majority of people should hold in common, it 
is equally true that social progress demands a certain degree 
of non-conformity, and that in a minority of individuals a re- 
fusal to accept or to be satisfied with certain modal attitudes 
or opinions is a socially commendable trait. There is no rea- 
son, however, why any given individual should be a consistent 
non-conformist in all situations. Specific attitudes must be de- 
scribed and measured separately if the descriptions and mea- 
sures are to be highly meaningful. 

This obstacle in the way of general attitude testing is one 
which also operates, but only to a much lesser degree, in gen- 
eral achievement testing of the type defined. Pupils who can 
and do acquire certain items of information, and who can and 
do understand or appreciate their significance, are also likely 
to (and should) acquire and understand other items of infor- 
mation logically related to them. While it is not implied that 
each pupil should or does attain the same degree of under- 
standing or insight into all aspects of a given field of subject 
matter, it is nevertheless true that the various insights and 
understandings gained will show sufficient consistency in degree 
from pupil to pupil to give considerable meaning to a single 
score earned on a general achievement test in that field of 
subject matter. It is true, however, that a test of this type, 
and the score derived from it, do tend to become less meaning- 
ful in proportion to the heterogeneity of the subject matter 
tested and to the consistency with which it is actually learned 
by pupils. (This point has been more fully considered in the 
sections dealing with the discriminating power of test items. ) 
It is desirable, however, that for convenience in administra- 
tion, and for simplicity in interpretation and application of 
test results, the scope of a single achievement test should be 
made as broad as possible. For tests which correspond in 
scope of subject matter to school subjects as at present organ- 
ized, the evidence which has been obtained concerning the re- 
liability of such tests indicates that they have not exceeded 
useful limits in these respects. 
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The Measurement of Attitudes in a Test Situation —While 
attitudes must be measured separately, and while their mea- 
surement may not be attempted in a general achievement test 
as here defined, nevertheless the suggestion may be made that 
the measurement of “‘general achievement”? should make use 
of a test battery, not intended to yield a single score, in which 
separate tests for the measurement of individual attitudes, as 
well as a “general achievement test,” will be included. While 
the merits of this suggestion are not the immediate concern of 
this article, it may be worth noting that, with present tech- 
niques at least, attitudes cannot be satisfactorily measured 
directly in the classroom testing situation. The pupil can be 
“held responsible” in a test for the rational experiences which 
constitute the subject matter itself, but he cannot be held 
responsible in the same sense for the emotionalized attitudes 
or beliefs which it is hoped will grow out of these experiences. 
To hold him thus responsible surely would be to encourage lip- 
service and the hypocritical acceptance of opinions which the 
pupil has not really made his own. It is possible, in a test 
situation, to test for what the pupil says he believes, and that 
is what is done to some degree in present achievement tests. 
A pupil may learn statements expressing any given opinion 
and be tested for these statements just as he may learn and 
be tested for other information. Whether or not he really 
believes what he says, however, and how strongely he believes, 
are problems that require more subtle treatment. Nearly all 
of the techniques that have yet been developed for the mea- 
surement of attitudes, as has been pointed out by Thurstone 
with reference to his own attitudes scales, must assume com- 
plete honesty on the part of the persons reacting to them. 
The unavoidable feeling on the part of the pupil in an achive- 
ment test situation that it is to his own interest or advantage 
to make as high a score as possible can hardly be said to con- 
tribute to the reliability of tests or scales of this type when 
used in such situations. 

Use of Attitudes Scales——Attitudes “tests” or scales, a3 
they are now being developed, do not have a place in the gen- 
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eral achievement test or in the classroom testing situation. It 
should not be inferred, however, that such scales do not have 
a very important function to perform. Pupils in our public 
schools do develop emotionalized attitudes or prejudices to- 
ward social problems, whether we want them to or not. This 
is the result, in part, of direct instruction, and, perhaps in 
greater part, of in- and out-of-school experiences. To a con- 
siderable extent, prejudices are developed through contacts 
with the older generation. It is extremely important that we 
have some means of describing the nature and intensity of such 
attitudes and prejudices. If we conceive it to be the purpose 
of instruction in the social studies to break down prejudices 
and to substitute rational appraisal and reservation of final 
judgment, then we need such descriptions in order that we 
may know what specific prejudices we most need to combat, 
and in order to evaluate the effectiveness of present instruc- 
tional methods for these purposes. If we conceive it to be the 
purpose of instruction to develop emotionalized attitudes, then 
again we need such descriptions for curriculum evaluation. 
The current demand for “attitudes testing,’ therefore, may 
spring from a most valid source, even though it has been mis- 
directed as far as the general achievement test is concerned. 

In conclusion, the reasons why the measurement of attitudes 
at present cannot and should not be attempted in a general 
achievement test may be summarized as follows: 

1. There is no general agreement that emotionalized atti- 
tudes toward social problems should be developed through in- 
struction in the social studies. It follows that it is not gen- 
erally accepted that pupils should be “‘held responsible” in a 
test situation for the development of such attitudes. 

2. Those curriculum experts who favor indoctrination have 
thus far failed to agree upon the specific situations or types of 
situations in which attitudes should be developed, or upon the 
nature of the attitude to be developed in each instance. Gen- 
erally acceptable attitudes tests for the evaluation of instruc- 


tion in terms of tests “scores”? cannot be constructed under 
these conditions. 
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3. Present techniques for the measurement of attitudes must 
assume complete honesty on the part of the individual being 
tested. Such scales are not likely to function reliably in an 
achievement test situation in which the pupil feels that it is to 
his advantage to make as high a score as possible. 

4. Attitudes are specific rather than general. If specific 
attitudes are to be measured effectively or meaningfully, they 
must be measured in separate tests. If attitudes scales were 
included in a general achievement test in the social studies, 
their presence would detract from the effectiveness of the test 
in relation to the function which it can best perform—i.e., the 
measurement of rational achievement. 


CURRICULUM IMPROVEMENT AND TEST IMPROVEMENT 


The function of the general achievement test (with the 
qualifications noted at the beginning of this article) in the 
social studies has been shown to be that of measuring the 
pupil’s rational achievements in relation to such immediate 
objectives of instruction as have been authoritatively and 
meaningfully described and provided with specific instruc- 
tional materials in the better textbooks and courses of study 
now in use. The specific content of a test that is to perform 
this function most effectively and economically is furthermore 
restricted by the achievements and abilities actually attained 
by pupils under present instructional methods. 

This does not mean that the attainment of ultimate objec- 
tives is in no way or to no degree measured by a test of this 
type. To the degree that the immediate objectives of instruc- 
tion are valid and will result in the attainment of the ultimate 
objectives, any direct measure of the former is of course an 
indirect measure of the latter type of objective. To the 
degree, however, that the immediate objectives of instruction 
have been poorly defined, selected and organized with ref- 
erence to the desired ultimate objectives, any measure of the 
former, no matter how valid or reliable for that purpose, will 
not provide valid measures of those desired ultimate objectives. 
Moreover, if the effective presentation of the subject matter 
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now provided and the satisfactory attainment of such imme- 
diate objectives as are at present specifically and meaningfully 
described do not result in the attainment of the desired ulti- 
mate objectives, then that is principally the fault of the cur- 
riculum maker and is something for which the individual pupil 
or the typical classroom teacher cannot reasonably be held 
responsible. 

An effort has therefore been made in this article to effect a 
clearer recognition, in relation to achievement testing, of the 
respective responsibilities of the curriculum maker and social 
scientist, of the typical classroom teacher, and of the test tech- 
nician, and to discourage the tendency to shift responsibility 
or to “‘pass the buck’’ which so strongly characterizes current 
discussions of problems of instruction and measurement in the 
social studies. Because of a general failure to recognize the 
restrictions just noted and the reasons for them, we now have 
the impossible situation in which the curriculum maker is crit- 
icizing the test technician because the latter has not been able 
to describe those immediate objectives and those specific in- 
structional materials which will lead to a realization of the 
desired ultimate objectives. It must be recognized that ulti- 
mate objectives cannot be measured directly, any more than 
they can be taught directly. The ways in which they may be 
tested are very much the same as the ways in which they must 
be attained in instruction: through the immediate objectives. 
General achievement tests, therefore, will come to be more 
and more valid as indirect measures of ultimate objectives to 
the degree that the specific materials of instruction are more 
wisely selected and more effectively prepared for their attain- 
ment. In a very real sense, improvement in achievement test- 


ing is limited by improvements in the content and methods 
of teaching. 


DESIRABLE CHARACTERISTICS IN GENERAL ACHIEVEMENT 
TESTS 


Up to this point we have been concerned primarily with 
an attempt to define the function of a general achievement 
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test. While we have given some incidental consideration to 
the means whereby that function may be best performed, we 
have not yet attempted to describe the desirable qualitative 
characteristics of an individual test item or the emphases that 
should be observed in relation to the objectives of instruction 
in the construction of tests of the objective type. 

The final purpose of this article is to present a detailed de- 
scription of a complete test of this type for a representative 
subject in the social studies, and thus to illustrate the more 
important qualitative characteristics of a general achievement 
test. 

During the past five years the writers have been engaged in 
the construction of general achievement tests in the social 
studies for the lowa Every-Pupil Testing Program and, more 
recently, for the Cooperative Test Service of the American 
Council on Education. In relation to the first of these proj- 
ects, we have recently had occasion to prepare a detailed de- 
scription of the 1933 lowa Every-Pupil Test in World His- 
tory. This description, which originally appeared in a circular 
distributed to schools participating in the lowa Every-Pupil 
Testing Program, seems admirably adapted to the purposes 
of this article, and will be reproduced here without revision. 
It may be noted also that, with the exception of some of the 
specific illustrations used, it represents a fairly close descrip- 
tion of the tests now being provided by the Cooperative Test 
Service in the various fields of history for high school and 
college. 


Description of the lowa Every-Pupil Test in W orld History. 


PART I 
INTRODUCTION 


The fundamental aim in the teaching of world history is to develop a rea- 
soned understanding of the great social, economic, and political movements and 
institutions which have contributed to our present civilization. 

This aim immediately suggests the necessity for an organization of the subject 
matter of world history around certain crucial topics or problems for the pur- 
pose of instruction. An analysis of standard textbooks in world history, books 
for the most part written by historians of recognized authority, reveals that 
there is a general agreement upon the major topics to be stressed in teaching. 
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For our own guidance in the construction of the Every-Pupil test, and also in 
order to provide teachers of world history with a convenient description of the 
content basis of this examination, a list of these problems and topics of out- 
standing importance has been prepared and is presented in Part III of this 
circular. 

While all standard textbooks in world history consider these topics and 
contain the information basic to them, it does not follow, however, that the 
textbook is self-sufficient and that the teacher need not prepare a carefully 
planned teaching organization for the course. The need for such reorganiza- 
tion grows directly out of the fact that most texts are organized on a chrono- 
logical plan, which often is not the best approach for teaching purposes. For 
instance, in working out the answer to the question, “Contrast the Greek and 
Roman attitudes toward foreigners and foreign civilizations,” the pupil almost 
certainly will refer to materials not printed on consecutive pages of his text- 
book. In the teaching of fundamental movements and institutions, therefore, 
it is necessary to select and reorganize materials in order to assist the pupil in 
developing a clearer understanding, a new attitude, or a critical viewpoint. 

The implications of the preceding statement are extremely important. The 
most desirable outcomes of teaching are directly opposed to the too frequent 
practice of limiting instruction largely to mere memorization of isolated facts 
presented in chronological order. It is not implied, however, that facts as such 
should not be learned, or that the pupil can attain a reasoned understanding of 
any major problem without first having acquired an informational background 
for such an appreciation. In developing a genuine understanding or a critical 
perspective, it is, of course, essential that the pupil master certain important 
facts or items of information. The point is that the pupil should not be asked 
to learn a fact which has not been made meaningful to him and which does not 
contribute directly to a better understanding of an important topic. It follows 
that the memorization of textbook statements which may make the pupil overly 
dependent upon unique phrasings or “pat” verbalizations has no place in good 
teaching. 

Perhaps the chief task of the teacher, therefore, is that of helping the pupil 
to see the relationship between the historical information taught and central 
topics of the kind listed in Part III of this circular. One of the most discourag- 
ing aspects of present history teaching is that it so often results in the training 
of human encyclopedias—of pupils who can glibly furnish “pat” answers to 
“pat” questions of the “who, what, when and where” variety, but who have 
failed to acquire any real understanding of history. In the study of the Reforma- 
tion, e.g., it is not sufficient that the pupil learn who posted the Ninety-five 
Theses, when and where they were posted, or what they contained. Such learn- 
ing has small value unless the pupil understands why there was a revolt in the 
Church, why and how it came about when it did, and why it was not sup- 
pressed as earlier schismatic movements had been. 

These, then, are the points of emphasis in good history teaching. It is 
obvious that a valid test must stress these same points; it must hold the pupil 
responsible for a reasoned understanding of major problems, in addition to the 
ability to recall pertinent items of information which of themselves, and in 
isolation, would be lacking in social utility. The manner in which the Every- 
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Pupil test will be constructed to observe this desired emphasis is described in 
the following section. 


PART II 


CONSTRUCTION OF TEST ITEMS 


It should be noted, first of all, that the organization of the items in the 
Every-Pupil test is not the organization to be followed by the teacher in pre- 
senting these same facts, concepts and problems. The construction of an 
effective examination often requires a peculiar grouping of test materials to 
insure a high degree of homogeneity in each section of the test. Thus it seems 
desirable to have a section devoted to chronology, one to historical personages, 
another to historical terminology, etc., although it is perfectly clear that such 
segregation of materials is unthinkable for teaching purposes, and almost cer- 
tainly is not the best type of organization even for review purposes. 

The separation of test items into logical and homogeneous categories in the 
Every-Pupil test, furthermore, is in no way incompatible with the desired 
emphasis upon measurement of the pupil’s reasoned understanding of history. 


That emphasis will be achieved by observing the following principles of test 
construction. 


1. In most cases where a test item holds the pupil responsible for a fact, it 
should also hold him responsible for an understanding of some implication of 
that fact, in such a way that a mere memorization of the fact itself will not 
enable him to respond correctly to the item. 


2. The implications for which the pupil is thus held responsible should be 
those which will contribute directly to a reasoned understanding of a major 
topic or problem such as those listed in Part III of this circular. 

3. In the construction of a test item, the wording of the correct response 
should avoid unique textbook language or verbal associations of the type most 
likely to have been learned by rote. This principle is based on the fact that the 
ability to recall or to recognize a unique verbalization is no positive indication 
of real understanding. Such a procedure in building test items will result in 
penalizing the rote learner but will present no serious difficulty to the pupil 
who has gained historical insight. 


As a corollary to this third principle, the phrasing of incorrect responses may 
at times deliberately employ verbalizations of the kind to be avoided in the 
correct response. As a consequence, the incorrect response will appear particu- 
larly plausible to the rote learner and the shallow thinker. 


The specific manner in which these principles are applied is made clear in 
the following detailed description of the separate sections of the examination. 


Section I: Chronology 


The first section of the examination will be devoted primarily to the testing 
of the pupil’s understanding of the chronological and logical relationships 
between important historical events. It will consist of exercises similar to the 
“Type C” example in the series given below. 

The following examples are presented to demonstrate concretely the factors 
involved in the construction of test items of the kind that will be used in the 
Every-Pupil test. These three chronology exercises exhibit increasing degrees 
of quality and effectiveness. The reader is advised to examine them, with their 
corresponding “directions,” before going on to the discussion which follows. 
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Type A 
Directions: Match each event with the proper date. 
I. 1517 ee OE TM, oi abba RRA ei ccs ctecceticicsccccsneenseus (3) 
2. 41555 s 
3. 1598 Luther posted the Ninety-five Theses ..............--eeeeeees (1) 
4. 1648 
5. 1688 The Glorious RevOltie cic. c cic cece cecciseccccesdeses (5) 
Type B 


Directions: In the following exercise, an historical event is described or 
suggested by each of the statements in the right-hand column. Match each 
statement with the time period in the left-hand column in which the event 
occurred. 


I. 1450-1499 A royal decree first gave extraordinary political and 


religious privileges to French Protestants .............. (3) 
2. 1500-1549 
3. 1550-1599 A great religious leader drew up a series of statements 
pointing out abuses in the sale of indulgences ............ (2) 
4. 1600-1649 
5. 1650-1699 Parliament restricted to members of the Protestant faith 
the right to succeed to the British throne................ (5) 


Type C 


Directions; In the following exercise, the four events in the left-hand column 
are arranged in the order in which they occurred. Each of the numbers in the 
left-hand column, therefore, corresponds to a time interval. Interval (1) is that 
preceding the first event, interval (2) is that between the first and second 
events, and interval (5) is that following the last event. Each of the state- 
ments in the right-hand column describes or suggests an historical event. For 
each of these statements, indicate the time interval in which it occurred by writ- 
ing the appropriate number in the parentheses at the right. 


(1) Council of Constance’ A royal decree first gave extraordinary politi- 
cal and religious privileges to French Protes- 


GRE, in ccd tuin< Rackae siete cee eels ket (3) 
(2) Diet of Worms 
(3) Outbreak of the Thirty A great religious leader drew up a series of 
Years’ War statements pointing out abuses in the sale of 
NOY i5 cia ctw aoa ESRRW ES condone cade (2) 
(4) Peace of Westphalia 
(s) Parliament restricted to members of the Protes- 
tant faith the right to succeed to the British 
oe otis oh ced CeTS Stee eee eseweedtes (5) 


The first example (Type A) illustrates a type of exercise which has fre- 
quently been employed in history testing. All that it requires of the pupil is a 
verbal association between a date and a name. For instance, if the pupil has 
memorized “Edict of Nantes—1598” and “Glorious Revolution—1688,” he can 
respond correctly to two items in this exercise even though he knows nothing 
about the religious and political significance of the Edict of Nantes, or about 
the consequences of the Glorious Revolution. 

The second example (Type B) illustrates a type of exercise which is far 
superior to the first. Each event is identified by a brief description of an 
important aspect, consequence, or implication of the event, rather than by its 
name only. The exercise now calls for some understanding of the nature or 
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significance of each of the events in question, rather than for only a verbal 
association which may have been learned by rote. For example, the pupil must 
know enough about the Ninety-five Theses to realize that they are implied in 
the description, “. . . a series of statements pointing out abuses in the sale of 
indulgences,” before his verbal association between name and date can func- 
tion in selecting the proper time interval. 

The phrasing of items of this type is of particular significance. Consider, 
e.g., the following descriptions of a single event, any one of which may be 
employed in a Type B exercise. 


Luther posted his Ninety-five Theses. 


Luther posted a series of statements pointing out abuses in the sale of 
indulgences. 


A great Protestant reformer drew up a series of statements pointing out 
abuses in the sale of indulgences. 


A great religious leader drew up a series of statements pointing out abuses in 
the sale of indulgences. 

The first statement requires only a verbal association frequently learned by 
rote. The second eliminates the words “Ninety-five Theses,” which the pupil 
may have associated with the proper date without understanding their signifi- 
cance, but still retains the unique word “posted,” which alone may be sufhi- 
cient to arouse the meaningless verbal association. Furthermore, the inclusion 
of the name “Luther” in this statement may enable a pupil to select the proper 
time interval if he can merely recall the approximate years of Luther’s life, 
even though he knows little or nothing about the Ninety-five Theses. The third 
statement removes the worst of these irrelevant “clues” or “cues,” but strongly 
suggests “Protestant Reformation” by the words “Protestant reformer,” and 
thus allows the pupil to select the proper time interval if he has memorized 
the date of the Protestant Reformation. The fourth statement, however, places 
the emphasis directly upon the content and significance of the Ninety-five Theses, 
and is singularly free from “clues” which may allow rote learning to function. 

In phrasing the responses to items in the Every-Pupil tests, an attempt will 
be made, therefore, to eliminate “clues” irrelevant to the point in question, as 
well as to avoid the use of “pat” or “catch” phrases that the pupil may have 
memorized without appreciating their full meaning. The phrasing finally 
chosen, however, will be as free from ambiguity as possible; i.e., it will suggest 
the event in question, and not any other. Finally, it will suggest the event in 
such a way that it is fair to expect the pupil to recognize the association—i.e., 
it will deal with a significant aspect or consequence of the event. 

Type B, then, represents a superior type of test exercise. It still suffers from 
the limitation, however, that it does not require the pupil to relate events 
directly to one another, either logically or chronologically. Type C, on the 
other hand, exhibits all the virtues of Type B and in addition requires the 
pupil to relate each event directly to other events. In this exercise, e.g., the 
pupil must not only know the date of the posting of the Ninety-five Theses and 
have some appreciation of their content, but he must also recognize their rela- 
tionship to earlier and later events. Thus, even though he may not be able 
to recall the exact date (which, after all, is relatively unimportant) of the 
posting of the Theses, if he appreciates the significance of the Council of Con- 
stance and the Diet of Worms, it will be obvious to him that the posting of 
the Theses must have followed the former event and preceded the latter. 
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Similarly, if the pupil understands the logical or cause-and effect relationships 
between the other events in the exercise, he will be able to respond correctly 
without necessarily resorting directly to the recall of exact dates. 

It should be clear, then, that the Type C exercise, which is the type that will 
be used in Part I of the Every-Pupil test in world history, is far more than a 
test of chronology or date-event relationships alone—that it calls into play 
much of the same sort of reasoning or understanding that is involved in all 
aspects of the learning of history. The prominence which may be given to 
exercises of this type in the test should, therefore, not be considered as an 
over-emphasis upon date-event relationships in the usual arid sense. 

Considerable space has been given to this exposition of the construction of 
chronology exercises, in order to demonstrate specifically and in detail, in at 
least one instance, the care and thought that are required for good test con- 
struction and that will be reflected in all items of the Every-Pupil test in world 
history. While equal space cannot be devoted to the description of the other 
sections of the test, it will be understood that similar problems are met in 
the construction of other types of items, and that similar care will be exercised 
throughout in the exclusion of irrelevant “cues” or “clues,” in the phrasing of 
responses, and in the attempt to hold the pupil responsible for reasoned under- 
standing rather than for lesson performance of the memory type. 


Section II: Matching Exercises 


As in former editions, the 1933 Every-Pupil test will include a number of 
exercises of the matching type, involving geographical terms, historical vocabu- 
lary, and historical events and personages. 

A. Geographical Terms. In a number of the matching exercises, the pupil 
will be held responsible for (1) a knowledge of the location of important cities, 
countries, rivers, mountain ranges, etc., (2) an appreciation of the space rela- 
tionship of one location to another, and (3) an appreciation of the historical 
significance of important locations and of their associated geographical features. 

There is considerable evidence that high school pupils lack an understanding 
of the geographical background of history. For instance, in the Every-Pupil 
test of two years ago, when pupils were asked to locate the city of Boston, some 
placed it as far south as Savannah, others as far inland as St. Louis, and still 
others as far westward as Cleveland. That these pupils were deficient in 
geographical knowledge is self-evident. Even more significant is the fact 
that they manifestly did not possess a reasoned understanding of, e.g., the 
American Revolution. The Boston Tea Party or the Boston Port Bill could 
mean very little to a youngster who thought that Boston occupied the site of 
St. Louis or Cleveland. 

It is not implied, however, that teachers should resort to isolated drill on a 
series of geographical concepts. To be most effective, the study of geography 
should be associated with meaningful context. For example, a proper occasion 
to consider the location of Boston and its geographical relationships is at the 
time that historical events touching this city are being discussed. 

Special emphasis will be given in the test to items requiring an appreciation 
of space relationships. Thus, a knowledge of the distance from Elba to France 
will help the pupil to understand the failure of the peace settlement of 1814, 
and the Hundred Days. 
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B. Historical Terms. The inclusion of items testing the pupil’s grasp of 
historical vocabulary is a valid procedure, because the pupil cannot have a 
reasoned understanding of what he reads or discusses if he does not com- 
prehend historical terminology. Early this fall, the world history class at the 
University High School, in the course of its work on the topic, “The dawn of 
civilization,” was discussing this statement: ‘The rule of arbitrary kings was 
a forward step in human progress.’ The recitation proceeded for some 
moments in pointless fashion until the instructor asked members of the group 
to explain exactly what is meant by the expression “arbitrary king.” He dis- 
covered to his consternation that not one pupil in twenty-seven could give a 
satisfactory answer. The need for clarification of word meanings was obvious 
in this case. In this connection, however, it is important again to stress the 
advantages of discussion in context rather than drill in isolation. To explain 
the meaning of the word “arbitrary” in connection with the topic under con- 
sideration was a far more effective procedure than to drill on this term at 
either an earlier or later moment. 

It is important also that pupils acquire more than a dictionary definition or 
a “pat” verbalization of concepts in the textbook. As often as possible, the 
items in the Every-Pupil test will be so phrased as to avoid the use of text- 
book or dictionary language. An attempt will be made to test for the histor- 
ical implications of a given term, rather than for the more obvious meaning 
or definition of the term itself. To illustrate, the dictionary defines “excom- 
munication” as follows: “The act of expelling or being expelled from the 
communion of the church.” Rather than use this expression, which might 
have been memorized without understanding by the pupil, the test item may 
require the pupil to match the term “excommunication” with the statement: 
“During the Middle Ages, its effect was to make the victim an outcast from 
society.” In this way, the pupil would be held responsible for some appre- 
ciation of the consequences of excommunication during this period in history. 

C. Historical Personages. In the teaching of the fundamental topics in world 
history, certain important historical personages are sure to loom large. Where 
a personage has vital relationship to a movement or institution, the pupil should 
acquire the ability to (1) associate that personage with the proper movement 
or institution, (2) describe his relation to it, and (3) judge the motives which 
prompted his actions in light of what is known about the period in which he 
lived. 

To illustrate the manner in which these abilities will be measured in the 
Every-Pupil test, let us consider briefly the following test exercise: 


1. Henry VIII His revolt against the Church probably would have 
been unsuccessful had the Emperor not been busily 


engaged in foreign warfare ..............e.eee0- (4) 
John Huss 
3. Ignatius Loyola He was instrumental in reclaiming a large part of 
Germany for Catholicism .............. ie eacenes (3) 
4. Martin Luther 
5. St. Dominic His conhict with the Church netted him great 
COR STUD Gk ce davechevecieeicarvasawee’ (1) 


In this exercise, the statements are worded to avoid textbook language. 
They constitute a genuine test of the pupil’s understanding of certain relation- 
ships of these men to the Reformation movement. Furthermore, the exercise is 
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highly homogeneous, and hence affords little opportunity for the pupil to profit 
by extraneous and irrelevant “clues.” For example, among the five personages 
listed, three revolted against the Church. The pupil must do some inferential 
thinking to determine that Luther, rather than Henry VIII or John Huss, is the 
correct response to the first statement. Of these two foils, the first is eliminated 
because his action could scarcely have been influenced by the Emperor; the 
second, because his conflict with the Church ended in disaster. Similarly, in 
order to find the answer to the third statement the pupil must decide how many 
of the personages mentioned were at odds with the Church and which one 
reaped great economic advantages thereby. Through elimination, the well pre- 
pared pupil will ascertain that the correct answer is Henry VIII. In some re- 
spects, the answer to the second statement is easier to discover; yet one of the 
foils is deliberately designed to attract the pupil whose thinking is superficial. 
Undoubtedly, he will seek to associate Catholicism and St. Dominic, and so will 
miss the point of the question completely. 

From this illustration, it is evident that rote learning and mechanical drill 
can little affect pupil achievement on exercises of this kind. 


Section III: Multiple Choice 


The matching type of exercise is well adapted to testing the pupil’s ability 
to associate worthwhile meanings with historical or geographical terms, his- 
torical personages and dates, or with events and institutions which may be 
identified by name. In order, however, to test for broader implications, particu- 
larly of things which cannot thus be identified, the multiple choice or best 
answer type of exercise is most effective. In one section of the test, therefore, 
the multiple choice exercise will be used in an attempt to measure such things 
as appreciation and understanding of cause and effect relationships, of motives 
underlying historical developments, of consequences of historical events, and 
of the significance of certain political, social, and economic institutions and 
practices. 

The following concrete examples, based upon items from the Every-Pupil 
test of last year, will serve to indicate the nature of the content of this section 
of the test. 

A major policy upon which the Italian Fascists and the Russian Bolshevists 
are in agreement is that of 


(1) establishing a dictatorship of the laboring class; 

(2) abolishing the private ownership of capital; 

(3) denouncing the doctrines of democratic government; 

(4) opposing imperialism as a national policy. 

This item illustrates the possibility of phrasing responses in such a way that 
each may appear plausible to the pupil who has only a superficial knowledge 
of history. It is commonly known that Bolshevist leaders advocate the policies 
indicated in the first two responses. Even the inferior student is likely to have 
this information. To the pupil not well informed about Fascist policies, there- 
fore, these first two responses will appear particularly plausible. The fourth 
response may appear plausible to any pupil who does not know the meaning 
of “imperialism” or who interprets it (as many may) as somewhat synonymous 
or frequently associated with “royalism.” The well informed pupil, however, 
who knows that the Soviet government ostensibly disclaims imperialistic ambi- 
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tions should also know that Mussolini has repeatedly asserted the right of 
Italy to increased colonial territories as an outlet for a rapidly expanding 
population. From this knowledge he should be able readily to eliminate the 
fourth response. 

An analysis of the actual responses made to this test item by the pupils tested 
last year reveals that each of the three incorrect responses was chosen more 
frequently than the correct response. The exact figures are: 26 per cent of the 
pupils chose the first response, 21 per cent chose the second, 19 per cent chose 
the fourth, 18 per cent omitted the item, and only 16 per cent selected the third 
and correct response. The possibility of making incorrect responses appear so 
plausible causes an item of this type to call for a more thorough and certain 
understanding than is required in the case where the pupil simply is asked to 
recall the correct answer without any suggestion, as in an essay question. In 
the recall type of test the pupil is likely to write down the first answer that oc- 
curs to him. Relying as he does upon memory rather than upon understanding, 
he is likely to record a “pat” statement which may be correct but which he does 
not fully comprehend. In the multiple choice exercise, the same idea, differently 
phrased, will often appear incorrect, particularly when the pupil’s attention is 
attracted by other plausible answers which otherwise would not have occurred 
to him. 

The next item illustrates an attempt to measure the pupil’s understanding of 
one of the causes of an important historical movement. 


Louis XIV hastened the coming of the French Revolution by 


(1) shifting the burden of taxes from the middle class townspeople to the 
peasantry; 


(2) increasing class distinctions and privileges; 


(3) repeatedly summoning the Estates-General, only to order its adjourn- 
ment when it opposed his will; 


(4) persecuting Catholics and denying them the right to freedom of 
worship. 


The foregoing item illustrates the way in which the well informed pupil may 
determine the correct response by resorting to a process of elimination, and it 
also illustrates further how plausible the incorrect responses may be made to 
appear to the rote learner, the shallow thinker, or the uninformed pupil. Any 
one of the four statements made seems a just cause for revolution. Any one of 
them, if they had all been true, would certainly have hastened the coming of 
the Revolution. Furthermore, if it described an action which actually did take 
place, any one of responses one, three, and four would perhaps be better than 
the second response. For these reasons, the uninformed pupil is more likely to 
select an incorrect than the correct response. The well informed pupil, how- 
ever, will know that Louis XIV never took any of the steps described in the 
first, third, and fourth responses—that he was the friend of the Catholics rather 
than their persecutor, that he neglected to summon the Estates-General at any 
time throughout his entire reign, and that he at no time lightened the burden of 
taxation on the comparatively wealthy middle class at the expense of the already 
impoverished peasantry. The well informed pupil, therefore, will recognize 
that any of these three actions, simply because they never were taken, could 
not possibly have hastened the coming of the Revolution. He could therefore 
select the correct response by elimination, even though he did not know directly 
or positively the information called for by the second and correct response. In 
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most cases, of course, his response would be made more certain by such positive 
knowledge. 

While the two illustration given deal with relatively specific information, 
the majority of items in Section III will be concerned with questions of a broader 
character. The following questions are illustrative of those which will serve 
as the basis for text exercises in this part of the examination. 


Why were the governments established by the enlightened despots generally 
unsatisfactory ?——What was one of the chief obstacles to the development of 
trade during the feudal age?—What was one of the important factors in the 
establishment of the supremacy of the papacy over the whole Church in the 
ninth and tenth centuries?—Why did the regulation of trade and industry re- 
ceive new emphasis in the seventeenth century ?—In what respect did the World 
War differ most significantly from previous wars?—Why was the American 
Declaration of Independence important in European history?—What was an 
important result of the enclosure movement in England?—What was an im- 
portant reason why no strong national state evolved from the Holy Roman 
Empire?—What was an important contribution of the Church to the recon- 
struction of the West following the barbarian invasions? 


Each of the foregoing questions was used as the basis for a multiple choice 
exercise in the Every-Pupil test in world history of last year. While exactly 
the same questions probably will not be used again this year, they do indicate 
the character of the questions which will be employed. 

Section III of the Every-Pupil test, as well as the earlier sections, will 
therefore emphasize to a high degree the principle that a proper study of his- 
tory should result, not in the acquisition of unrelated facts or of information 
concerning isolated events, but rather in an appreciation and a reasoned 
understanding of the broad implications and consequences of a whole series 
of related events, of major historical movements, and of important institutions 
and practices. 


Reasoning Required during the Test Period 


It should not be inferred from the preceding discussion of the Every-Pupil 
test that all of the reasoning required for a correct response to each of the 
items must be done by the pupil during the test period. Good teaching will 
have led the pupil to consider all of the central problems upon which the test 
items are based. The pupil, therefore, who has previously thought through 
these problems will to a large extent need only to recall or repeat reasoning 
already done. The point is that, while the items will in most cases call for 
reasoned understanding rather than rote learning, most of the reasoning should 
have been done during the course of instruction and prior to the examination 
period, rather than during it. The pupil who has done no such thinking pre- 
vious to the test period will undoubtedly be unable to respond correctly to all of 
the test items, no matter how well he may be supplied with historical facts. 


Relation of the Every-Pupil Test to “Cramming” 


The characteristics of the Every-Pupil test in world history are of particular 
importance in relation to the practice of “cramming” in preparation for ex- 
aminations. It may safely be asserted that, as a means of securing superior 
pupil achievement in this examination, “cramming” in its undesirable sense 
of rote learning under time pressure is certain to prove futile. If pupils depend 
primarily upon unique verbalizations learned by rote, they are likely to be 
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confused and handicapped, rather than aided, when they meet (as they will) 
the same concepts expressed in new words and applied to novel situations. 

These claims for the Every-Pupil test are substantiated in part by an experi- 
ment conducted in the Monmouth, Illinois, High School last year. Two large 
groups of pupils in world history were equated on the basis of a comprehensive 
test in that subject. One of these groups was then deliberately instructed to 
“cram” as intensively as possible over a period of two weeks in preparation 
for the Every-Pupil test in world history. The other group was permitted to 
continue the regular course of instruction without interruption and without 
review or drill of any kind. When the Every-Pupil test was then administered 
to both groups, it was found that the “crammed” group excelled the “non- 
crammed” by an amount equal to only one-half of one per cent of the average 
score—a difference of completely negligible importance. 

It is to be hoped, therefore, that one of the most valuable outcomes of the 
Every-Pupil testing program in world history will be the encouragement of 
teaching for understanding rather than for mere recall of uniquely phrased 
facts and concepts. By stressing the importance of appreciation and under- 
standing, the Every-Pupil test will contribute significantly to the improvement 
of secondary school teaching in history. 


PART III 


BASIC TOPICS AND PROBLEMS IN WORLD HISTORY 


The purpose of the following list of topics has already been indicated in the 
introduction to this circular. It is sincerely hoped that what has been said in 
the preceding pages will enable the teachers of world history to use this list to 
maximum advantage. (N.B.: The following list has been abbreviated for the 
purposes of the present article. The topics here listed are therefore to be con- 
sidered as illustrative only and are not intended to be comprehensive.) 


1. Why should pupils study world history? 

2. Explain the specific ways in which human progress has been affected by 
such basic inventions and discoveries as the use of fire, the use of metals, the 
wheel, oral and written language, etc. 

3. Why did civilization develop early in the Nile and the Tigris-Euphrates 
valleys? Compare these civilizations. 

4. Evaluate the significance of the city-state in Greek life. Why did the 
Greeks fail to effect a united leadership? 

5. What did Greece contribute to human progress? How was Hellenic 
civilization spread throughout the Mediterranean world? The Orient? 

6. Show how Rome founded a world-empire by unifying the Mediterranean 
countries. What were the effects of the Roman conquests upon the conquered 
states? Upon Rome itself? 

7. How did the consolidation of the Roman Empire pave the way for the 
rapid spread of Christianity? 

8. Contrast Christian culture with earlier pagan cultures. 

9. Why was the Church the great conserver of civilization during the Middle 
Ages? What was the nature of its services? 

10. Evaluate the causes and results of the revival of learning. 

11. How were the questions of religious toleration and of the respective 
powers of king and parliament settled in France and England during the 
seventeenth century? What was the significance of these settlements? 

12. What have been the social, economic and political implications of the 
revolutionary progress in industry, communication and transportation? 

13. Trace the important nationalistic movements throughout the world since 


